But you CAN already cancel out of the queue?

Just click on the top right, above your duties where it tells you what position you are in and it should give you the option to cancel out of it. I have done it like last week, so I know for a fact that feature is already in.