I've run out of Shards, Crystals and Clusters all the time. Particularly right now Fire and Water clusters, I've gone through well over 10000 of each.

You're probably not crafting very much. Even at my peak I was only doing a round of crafting for 2 retainers every 2-3 days.