Skill Speed only works in tiers of 60 points. (The tooltip will show every point effecting the GCD, but it doesnt actually effect the GCD.)
Every 60 points is a 1% decrease on the GCD.
So you'll want to keep this in mind.