I've noticed this issue when using the Legacy movement settings. You can zoom out all of the way but if you go against a wall or something your camera position doesn't go back to where it was. You can actually set this as an option with the standard movement settings to keep your camera in a fixed position, but the option is totally greyed out for the Legacy movement. I would like to have this option available for Legacy movement as well, as it sucks having to zoom your camera out every time.