Probably just confirmation bias. Because you dislike that specific dungeon, you are more likely to remember/note whenever you get it.