It was something buggy. I was standing on the pillar you suggested, and anywhere I went the fishing button was greyed out and couldn't be used. I got frustrated, and started pushing every ability button that was lit up. I hit chum, and it tossed out chum and had me in the fishing position. Then all of a sudden my fishing button's light came on.

I hit it, and it fished. Ever since I've had no problems.