An easy fix for this would have a skill proc a chance to remove the cast time - Like blocking an attack, etc. It has high enough MP requirement that it couldn't be taken advantage of.