Loss of recovery if things drift out while moving, as well as just less recovery over time anyway.
Unleash has its uses, no point in cutting down our options even more.
As it stands right now, you can do one then the other by dropping in and out of Grit. Your suggestion cuts down on possible MP and Blood generation.

There are plenty of things that would help improve things, these aren't those things.