It's incredibly annoying, but it happens in all group content. Usually the timer runs out, meaning someone missed it, not just changed their mind. And to be fair, I'd much rather get put back in line to get someone who's actually at their computer than start with AFK members.

But yeah, I think we've all raged a little at that one dps that can never click the damn accept!