Yeah, closing that window with Esc/Cancel or the X in the upper right doesn't withdraw you. I do that all the time, and just pop it back open and hit Commence. IIRC, in addition to opening it through the duty list, you can open the duty finder window and there's a View Status button that does the same thing when you're in queue.