You don't turn in the Luminous Crystals for the quest

You turn them in to an NPC in Mor Dhona on top of Rowena's place that exchanges them for the Astral/Umbral Crystal Nodules or whatever.