I take it off if the fight doesn't need it. Susano and Lakshmi EX don't really need it, for example, as their debuffs can't be removed. :B