I can't be the only one that has thought this... and I know it only takes a sec to recast.. but in cases like Atma farming, your brain is already numb from the countless fates so you forget to rebuff sometimes...
It would be nice if the buffs we already have on us that are usable after syncing our level for a fate would stay on. Not sure how hard that would be to implement but it's just one of those annoying things.. :p