The crystals are used in the Ultima Weapon fight. Throughout the fight the 6 crystals will appear around the players and the floor will be flooded with light. This also happens whenever a primal is removed from Ultima.

They are also used to shield you from the Ultima spell, at which point they are "spent".