See the thing about this is, fish are alive autonomous creatures.
They don't want to be caught.
Rocks and trees do not have this sentience.

It entirely makes sense that fishing isn't going to be guaranteed. Just like IRL.