It is rather irritating to have to wait so long to get into dungeons. Especially main quest related ones that you have to complete before you can progress.

Perhaps for those ones they could have some sort of fall back mechanism whereby missing party members could be replaced by npcs after the wait goes over 5 minutes.