You gimp the group, which keep in mind, is a public group. Of course people have the right to be ticked off with you, their not the ones in the 'wrong' (your not in the wrong, but your not the best). I disagree with the abusing of other players, but the vote kicking sounds perfectly fair. If you want a group which caters to your specific needs, use the PF or create a pre-made group by other means.