I have the problem too. It's mostly a thing with servers with latency but it doesn't help that the animations just love to be obstinate when allowing you to let an ability go off.