Easier fix that just came to my brain, make Crystal Tower non-mandatory. That way less people do it, and it comes up less for those that are done with the story already.