Usually happens when in the rough but you will swing and after you click to hit the ball your avatar does a 180 and hits it the opposite direction.