Damage from Spirit/Phantom Dart seems to scale with INT, and I have experienced significant increases in damage from spells like Aero with higher INT, but this is testing with INT in the 140-170 range. I'm not sure what difference it would make at that level. Unless you're like me and really want to play as a Black Mage, I'd recommend not worrying about INT too much.