There are simply far more people who would exercise their imagined 'right' to get rid of someone -- anyone -- for some reason than there are players who are willing to disrupt gameplay by going AFK. There is no way around that. As such, any argument about the abuse that begins with 'Well its sad...' can rightly -- and more accurately -- be said about the situation that is causing the desire for this function in the first place.

I think the superior answer is for SE to name AFK'ing and assorted frippery as 'disruptive to gameplay' and enforce the Code of Conduct on it, up to and including permabans. There is simply no way to insert a Vote to Kick that isn't sufficiently safeguarded against abuse.