You may "Play Now" first, opening the game window. The invite will be there, too, unless it has been withdrawn - some ppl are very impatient and don't wait for long.
You should have to click twice on the invite, once to open it and see what's up, and again on "accept" to join the game.