You can now log out and switch your servers then log back in to bypass this issue now. Before you were truly stuck, now you just need to wait in line somewhere else (until congestion is resolved).

As for queue priority, I can see both sides. At least the person queuing is able to play, even if not on their home server for the time being, and they have a way to get into their server by getting in line. On the other hand, you can't access several features unless you are in your home server or play the game while queued for transfer.

I think it makes sense to share the queue for the world, but the world transfer people should get in the back of the line, not skip to the front. That said, it's probably not easy to do that on the technical level. Those queues likely exist completely separately on the backend.