I looked through Character and System config and don't see any setting to prevent it. Personally, I don't mind it at all - but things like this should indeed be configurable so you can turn them off if you like. So it sounds like we have a good suggestion for the devs but no better answer for you other than "No."