Were you on a DoL/DoH class? I don't think the timer counts down unless you're on a DoW/DoM class. That includes while logged out. I logged out as a miner once with a 13 minute timer, and logged in about 18 hours later with the timer still there.