You would need to change it so the votes only occur as you leave the dungeon. Some people can be nice, until they have what they want. It is the politician style of politeness.