As the others have said, use the support desk. The Vote to Kick system is very beneficial and usefull at times, and yes it can be abuse. But as Naoki Yoshida said the GM's were informed to consider it a serious offence in cases where it's abuse and so far the results of that have shown that they do take it very seriously (as I've seen and heard so far).

To file a GM report go to;

[Main Menu (ESC) > Support Desk > Contact Us > Report Harassment]

File in the details;

Your World:
Instance:
Approximate Time (Local Time or Server Time):
Suspicious persons in question:

Adding in one or two quotes such as;

"/p Lets just kick him guys, lol"

Would make the GM reports investigation quicker in discerning if you were kicked rightfully or not. All you can do is report it.