I don't have an issue queueing for dungeons in general.

It's when it's a mandatory story quest to move things along that it's an issue.