If he kept pulling early you all could have stepped out of the barrier and let him die.

If he was verbally harassing, you could have blacklisted or ignored him.

In-game tools, use them.