I don't know if it's just the way I have my options set but I generally use the right mouse button to look in the direction I want to go before actually moving. Which is fine in combat mode, but for botany and mining you are locked in the direction you are facing for a second or two. So no matter where the camera is pointing, you instead run in the direction you are facing until you release and re click the right mouse button.
It is very annoying...