Or by the same token you could increase the chance of those 10 attacks to do significantly more damage far outstripping a single extra swing (and conserving TP in the process).

Skill/Spell speed really ought to affect TP/MP recovery as well, then they might be competitive - especially if SE ever decides to bring back +crit damage which I was sad to see leave the game. Or if skill/spell speed affected auto-attack speed as well. It needs *something* to really be competitive, as it's nowhere near as good as Haste was in FFXI (not that I want it to be - Haste was entirely too strong in XI, but SS is far too weak in XIV).