Pro-tip: Kick them as soon as the fight is over, and before they click on the treasure box.

Doesn't work in Crystal Tower series unfortunately, because the fights are way too fast. But I've managed it in every other raid.