Bug,
your concerns have been cared for, as you will still have two chances to wave good-bye after accepting the invitation:
- during your own set-up time, you may discard/reject,
- while waiting for the tee-off by the owner, you may still cancel (button below) and get ot of the lobby.