What about the whole watch vs. skip cutscenes? If someone wants to watch their cutscene then i can see this being abused to kick that person.

There are even people who openly talk about locking the person out of the boss fight on purpose because they don't skip the scene. This would be one more tool for people to use towards implementing their will against others. So maybe a kick/vote system is not the best solution.

There appears to be several good suggestions in this thread that should make everyone happy.