I'm not a big golf player but I can see how swinging too many times could wear you out.
I think a lot of golf has to do with natural talent though.
Just like any other sport, really.
If you aren't born with it, you can improve, but you'll never be a Tiger Woods type golfer, you know?