This has happened to me before. Sometimes it takes me two minutes to load into Mor Dhona, thanks to my barely-able-to-run-this-game laptop.

I just eat the penalty. I don't mind... besides, even if you could accept, the game would still have to have you load onto the map that you're trying to get to, THEN load into the dungeon...