Always report if you feel you've been kicked for no reason. I had some "followers" who were always trying to kick me from duties (yes, there's people like that) and I reported them. They never tried it again, guess they got a warning from a GM.

If you're lucky enough, reporting them will make them getting banned for 3 days, but if you don't report they'll keep doing it to you/other people.