Hrm, actually, gathering fatigue seems to refresh somewhat fast. 12 hours and i'm pretty sure you're good go again, probably not even that much.
I saw research being done around here that seemed to indicate that, however, it's buried in the past and i'm not confident enough to give you an assured answer.