If you're gathering and you think a FATE or anything else will interrupt you, use should be using Stealth.
Yeah it's a pain to move slow but honestly it's worth the trouble of not being interrupted.