You do experience lag with normal skills, but the lag is hidden in the animations and generously long globals. Mudra can't hide these delays so well because the timing is much stricter.

Anything that improves your latency may make an improvement. If that doesn't work you're kind of out of luck.