Quit playing with just whoever jumps in the game/match/etc. Play with friends you are familiar with. The best thing to do would be to join a CC, make friends, and you won't have that problem.
Buy a 10-pack of legal pads, and write the names of the quitters down (alphabetically) , and before you let them play, check the names.
The former is the better idea.