Often even a slight movement will satisfy it, so just take a few steps and try again. Some locations are pickier, and for those you'll have to move to a different fishing hole, fish once, and then you can go back.