Agreed. Once you've completed a duty, it should be cleared. I recently did a trial that went badly (died 6 times), and definitely didn't want to run it again). Later, I queued up a couple dungeons, and ended up in the same trial again. I left group, and ate the 30 minute penalty.
I guess the fix is to click the Clear All button every time I enter DF.