I wouldn't mind the added option for those to whom it'd matter. I'm just not one of them.

If not an option, then I'd absolutely not want this change.

As far as balance goes, I don't see why it would be an issue outside of flat potency increase 'next action' buffs, which are found only on BLU and MCH anyways.