As others have said, it's just a matter of RNG.

You'll find that some big fish will be surprisingly easy to catch and others will be near impossible by comparison - especially since you can wait a long time just for the weather window to line up so there's an opportunity to catch them in the first place. Personally I think the catch rate could stand to be improved somewhat. At least for some of the older big fish.