Well, if you put too much of a punishment on the one who's kicked, how are you going to distinguish legit, warranted kickings from malicious griefing? Something small would be okay, a 5-10 minute inability to queue perhaps.

For any real punishment, SE would have to track people who get kicked regularly, not punish anyone who's kicked even once.

I wish they'd also look at people who tend to start kick votes, because there seem to be some people all too ready to kick someone over ridiculous things. I saw someone suggesting that a newbie in a dungeon who doesn't watch a video about the dungeon before using the duty finder should be kicked (and banned).