I thought it was natural that you would move more slowly when trying to sneak past monsters unnoticed.

There is no need to keep stealth on all the time. Where are you gathering?