One of the best ways to prevent abuse of a vote kicking feature is to add a "kick" memory to each player. If someone uses the kick too frequently, then they incur an increasingly lengthy IRL timer until the next time they can kick. It's not fool proof, but it makes people try to save kicks for when they get someone who is actually really bad/goofing off instead of just kicking someone because their gear is slightly sub par.