As of right now the best way to deal with this would be wait for about 5 mins before allowing "finding more member", that way if the said kicked player decided to requeue again to join in progress, the player might end up on another instance or another join in progress instance.. The player also may gain penalty from trying to get into your instance if the player clicked withdraw 3 times