This is working as intended from my understanding. Its not tied to the use of buffs/GP but forces you to move on after fishing too long at one spot. I believe it is an anti-bot mechanism.