Enter dungeon.
Check if the DPS is what you want (or if you want a WHM if it's a SCH).
Boot the DPS you don't want (or healer)
Repeat until you get the set up you want

Well, that's one way to abuse a kick system, better hope you don't want to level a DPS that isn't optimal for dungeon X. Cue threads "remove the kick feature!".