This isn't the case with the gamepad on "Standard camera" (i.e. character turning). As a healer, I always start casting my spells and am still able to turn or focus on other things on the battlefield (as long as my target is within range). Just saying, it might be a mouse problem or bug. I play on PC, by the way.