In ranked and rated rounds, the pass stays active if you can return to the game.
Different outcome is most probable in multiplayer games, therefore passes should not be used there. Also, it's not advisable to buy passes unless you have too much credits.
Those lost balls are meant to remind you to check all settings as a part of your pre-shot routine. Don't trust the auto-caddie, NEVER!