The timer is pretty generous. I think it's just the game's way of saying, "Hey this isn't working out, you did your best. Better luck next time."

I think it should be paused if your group isn't full and you are looking for a replacement on the DF though.