I do not feel that a team should be charged with a loss if a player has trouble connecting.
This has happened to me a few times, sometimes before even one shot has been hit. For the record, I've been on both sides of the coin where I have received wins and losses due to a player being unable to connect. Usually one of the other players just gets impatient and forfeits the match.