Just going by my feeling of how combat in this works, I think that skill speed's benefit may be limited in the long run due to attack animation locks and resource needs.

If you attack too fast, you may experience TP starvation. If your GCD is faster than the animations, you'll have dead time anyways. Crit/Determination just feel like they'll give a more consistent contribution to your damage, especially in longer fights.