I agree it was my biggest gripe about the game when I first started playing. It gets much better once you uncover most of the map and now I don't even notice it. It was probably my biggest pet peeve when first starting out. Stick with it and soon you won't even notice how bad it is.