I think the system is the one doing that if you AFK long enough. It's also hard to know who initiated the vote.