If 3 of the 4 players in the dungeon agree that they don't want to play with a 4th, then let them kick the person, instead of having the whole party be ruined. Maybe give them priority in the queue, just in case they were unfairly kicked or something.