When putting from the fringe or fairway you must attend the pin yourself if you want it out. The same is true when pitching, chipping, hitting full approach shots or even teeing off on par 3 holes where you might hit the pin and have the ball fly 20 or 30 yards off the green. Some players remove the pin on every shot that might land on the green. Only you have that choice, not your caddy who ill only remove the pin when you are the green putting.