Only allow the vote as you finish and leave the dungeon, not before, or else you will get pressure to vote trade with the implication that groups will be dropped if you dont go along with it.