Fishing fatigue: why exactly?

[StouterTaru]

you know u can take 2 steps to the left/right and cont to fish right?

I've left the zone, logged out, gone to bed, got up the next day, went to work, come home, done other random stuff in game, come back to the previous fishing hole, and the fish still sensed something amiss.