Just a thought - are you waiting until the spell animation ends before starting to cast your next spell? If so, you don't need to. As soon as the cast bar vanishes from your screen, you can cast again.

It took me a little while to work that out, since it's not instinctive when your character is still theoretically occupied with the spell as it goes off - but the game doesn't see it that way.