Just like it's my right to leave a dungeon if they aren't. No real problem, just deal with what's happening or leave imho.
Oh, I have no problem with people disagreeing with me, leaving, in fact, I highly encourage it. I would rather have them leave on me, since I am not in a hurry and they are, they chose to willingly accept the wait time. The problem feels very real to me though. There isn't much else I can do but try to deal with what I am thrown with, I much prefer settling friendily than leaving, not because of my own time loss, but because the situation out of my control made me "waste their time", which is such a serious problem nowadays to waste time that they practically hold a grudge against you for not complying to their demands and then using your right to leave to get out of it all.