Just to clarify it's not someone trolling, it will be a tank who keeps pulling out until he gets a dungeon that's in progress.

I do agree though, it's really annoying and I hope SE do something about it, a cooling off period after pulling out 2-3 times would do the trick.