It's happened to me a few times as well. I just move to interrupt my cast time and cast again and swiftcast works. My best guess is it's probably an animation lock.