I thought spell speed affects your global cooldown, which isn't necessarily related to your individual spell casts or recasts.