Since we already have a Glamour system, why not implement something like this?
Most, if not all accessories just doesn't match with the Glamour gears. Take this Hyuran Tunic as an example, seriously? I'm already wearing a necklace FFS. It just ruins everything.
A simple on/off feature similar to how we can turn on and off the Visual Graphics of Weapons and Headgears will do the job perfectly.