Total speculation, sure, but I gotta say that too much gathering may indeed be a hindrance in some instances. I had no problemo catching my first twenty HQ Sovereigns (was catching about six per day), but can't catch 'em to save my life (one per day now with the same time investment) now that I have the Forager's Rod. Seems easy enough to make a similar assumption/speculation regarding other Big Fish.