It just entirely depends the context. The current system has flaws (People who are causing grief can prevent themselves by being kicked by opening loot chests or pulling mobs.)
Yea, some people do abuse the system and kick people for no reason but I find it's pretty rare.
It depends on what you're doing, is it possible you're doing something that is causing other players to kick you. It may not seem kick worthy to you but it might be kick worthy to them.