Soulcatcher: You will have a better chance of holing shots if you pull the flag every time you are shooting at the green.
My philosophy is the same as Soul's, but admittedly you will never really know what an actual shot would have done if the pin had not been pulled or vice versa.
Replays are misleading because as far as I can tell, when you watch a replay the pin is always replaced in the hole.