As far as golf being athletic, I would say, go try it, let's see how well you do. It's a hard game.
Golf has always been a game where you have to control both ends of the club.