So you'd rather people be punished when they're in a horrible group? Let's say you're doing a dungeon you've run over 50 times, you know it like the back of your hand. You have the patience to teach new players and so forth. You repeatedly wipe on one boss, and despite your best efforts at explaining the fight to said new player they cannot seem to grasp the concept of the fight and do the opposite of what you say, or simply are too slow to react to an attack that instantly kills them... You're going to totally want to leave said group, but if you have a rather punishing debuff from leaving, you're stuck there. See where your logic at that is bad? Vote to kick will help alleviate some of that, but not all of it.