If you are using a Retainer Fantasia to change your retainer's appearance the game will first instruct you to remove your retainer gear prior to change. All sale history, current items for sale and retainer exp will remain intact.