You have two options: deal with it, or leave the group. If the players aren't on your server you won't ever have to deal with them again anyway.

Starting with patch 2.1 if everyone else agrees one person is being a jerk, you can vote kick them.