To "fix" this particular problem, my kneejerk reaction would be to offload part of misery damage onto an oGCD or buffed Glare replacement that you can only hold one stack of which you gain after you use a lily heal.

Then, burning more than one during downtime is a damage loss.