I think you need to kill the dragonfly closest to the dungeon to trigger it. some kind of place holder mechanic.