Now, this is a problem.

I'm the first one to admit that the afk guys have to be kicked, after all, it's not even aceptable to have someone leeching on everyone else hard work.
Now... on the other side... i agree that the community is not mature enough to use this option correctly. There will be unfair kicks. If one of the party member lags and take a hit, someone is bound to kick that guy.

Not a easy problem to solve, however, if there is a VOTE to kick, the problem may be solved if the votes needed correspond to the majority of the team members.