Here's the problem---let's say I queue for duty finder as a bard and while I wait for the duty finder to "pop", I switch to botanist and spend the next 15 minutes chopping down trees. Then as I'm just about to press the circle button on my controller (perhaps to get out of a menu), the duty finder window appears...

... and interprets my button press as "canceling" the window and it withdraws me from duty. I imagine the same thing could happen if I were clicking the screen with a mouse and the duty finder magically appeared underneath the cursor and interpreted the mouse-click.

This has happened to me many times...

A fairly simple fix would be to make it so that when the duty finder window pops-up, there's a short delay (2 seconds?) before it become the default window. Perhaps this delay could be negated by mouse or controller actions (much the way that the "away from keyboard" status is removed).