3 times a week for gym is more than enough
Working out 3 times a week keeps you in shape. Body fat dont really mater here. You are fit to do whatever you want at higher efficiency. 2 times is not enough, 4 times does almost no difference.
3 times keeps you in shape and if you do it properly, it really does matter. One can exercise 6 times a week and have no results, when other can show significant gains with only 2 times a week. You must know what you are doing and like said, eating is more important than training.
2 times is enough, 4 times makes a hell of a difference. Gym 2 times a week will shape your body in the right direction (again, if you know what you are doing) and 4 times can bulk one up a lot.
75% of the people in gym do not know what they're doing, they think they need to train more and more to get results when it's the way they're doing it. It's sad and funny at the same time to look how some (most) people train.
EDIT: I have a mate who had trained for 3!! years 3-5 times a week with almost no gains (just lost some bodyfat). I made a proper diet- and exercise plan for him and we (he) trained 3-4 times a week and had more progress in 2 months than in 3 years. After 6 months he had achieved what he wanted.