You just type /leave to leave a party. I haven't tried it in a dungeon but sure works once we left the dungeon.