No, so long as you have the Quest active in your Journal you can gather as many Crystals as you like, there isn't a unique cap on them. You could literally farm 99 if you wanted.