The setting under Character Configuration > Item Settings > "Store all newly obtained items in the Armoury Chest" is supposed to place all gear you receive in your inventory when disabled, however it does not apply to retainer gear which when removed is placed in the armoury chest.

I don't know if this is a bug or intended, but either way it's only a minor annoyance.