Well it's not like you lose most of your progress by switching what you're desynthing.
Your ltw may go down by a few decimal points while you start on something else but it's not going to drop back to 0.

Considering you can max out three classes, may as well switch to do something you actually want to do now, and pick up ltw desynth as items casually come in.