You need it on at the start of the cast for the reduced casting time. You still need it for the completion of the spell if you need the reduced recast (which you should probably be wearing haste gear for anyway).