If someone is causing problems for you kick them ASAP. Do not wait and hope it gets better. It won't.
Eliminate the issue, before it becomes a major issue.
This is the best advice I can give.
you want to seem fair, so you don't kick, but that is a major error in judgement.
Save yourself a lot of pain and kick people who are problems as soon as you can.