The rules on a vote to kick don't need to be hard or complicated.

Majority vote, cooldowns on whoever started it, can't do it during loot roles, and a timer for cutscenes.

That's it IMO, too few or too many restrictions will lead to some abuse.