Players who select Withdraw from the Duty Ready confirmation window or allow the window to time out without making a selection three times or more in one day, will be temporarily prohibited from registering for duties via the Duty Finder.

This count will reset every day at 9:00 a.m. (PDT).
Seems pretty clear from this that 3 withdraws locks you out until daily reset.