I see three possible szenarios:
- your avatar was turned but your aimer was well in place where you wanted it. Then, the shot should have gone where you desired.
- the avatar followed the aimer to an unwanted point due to an inadverted error of yours. Then, the shot would go astray.
- some new game error that I don't know lead to a different outcome.
For analysis, it would be best to have a replay URL from you.
To avoid it the best you can, make sure that the marker shows about the distance of the desired shot or even more. This avoids some nasty deviations of "too close" aimers.
On a different note, I'm reminded that some players get fun from turning the CTTH games to FFTH (furthest from the hole). Select Starter balls and try to aim away from the hole to achieve the biggest number possible in a nine hole game!