Yeah, it's really annoying especially after you rotated the camera and it selected your party member without you realizing it. After that, I kinda wonder why the heck my skill didn't go off.