I'm surprised no one else has mentioned this ... At beginning of your potd run, tell the party what you are after and if they are willing to do it as well. Whether it be silver chests or speed run's or what ever. If they don't want to do what you do, leave and queue again. Queue's are almost instant most times and leaving on the first floor gives the other group enough time to find a replacement if needed. Just seems like an easier solution in my head. Oh, this is only for duty finder of course, if you set up your own party, then this shouldn't be needed ... I would hope.