I did the 20 fishing quest not that long ago, there are no agro mobs at all on the path.
It looks like you need to go down to the crabs but you do not. There is cave right the right when you leave limsa that leads down there to the fishing hole. No agro mobs at all.
