It's called deviation and is frustrating as all get out. You would think a ding would give you your best result but the way the game deviates it's possible your shot hit the outermost part of your deviation circle.
I find that missing by a pixel on the side of the wind keeps this to a minimum. Hard to do but helps keep the ball on line.