What if there's a slot that allows you to add a cloak, scarf, etc... without benefits just for the sakes of Glamour?
No one would feel forced to use them, unless it happens to look cool on your current armor set/clothing.