A 5F is overkill, I wouldn't go more than around 2.5F. FWIW, I've used 1.5F 5V caps for years, they've never had any issues. I prefer to put the last amount of overload on the charging circuit, so I try to tune for the minimum.
Remember, the cap is only called on occasionally, and only for short periods of time.