Skill Speed impacts:

Damage over time effects, global cooldown, and auto attack potencies.

Most jobs have a GCD they want to hit to get in a certain number of skills in their burst window and not really any more. Monk and Black Mage I believe are currently the only two jobs that really gain from a super low global cooldown, so likely you won't want to stack it for bard.