that isn't a bug, that is someone who cannot wait the few seconds it takes for you to respond to the invite. Whenever I invite, I wait until the timer runs out, the person I'm inviting may be out of the room at the time, etc.
Have some patience, fokes who invite then expect an immediate response. Some of us take a bit to respond, give us some time.