Yep, they all need to go. If you can wear it (on any of your classes) you should be able to glam it. FFXI did this, and it didn't harm anything.
FFXI also clearly adopted glamours because this game had them, so that's an example of a much older game taking a system that exists in this one and actually improving on it. There's no real excuse for why this game can't.