Should have reported that other dps, I think. The one guy was toxic and you had every right to kick, but doesn't matter how funny the dps thought it was, his behavior was just as bad for forcing you to put up with it. He's guilty of just as much harassment as the one making all the fuss.

(I'm assuming that he was just not casting a vote and letting it time out, since in a 4-player dungeon all it would take is two votes. Even so, I'm not sure why the system wouldn't at least count the votes that were cast. )