Yeah, maybe a full rework of the retainer interaction would be good, provide an actual UI screen to interact with them, have them all be summoned to you at once and the UI interface could have all of the retainers as portraits on the side letting you quickly select the retainer you want to work with at that time and then manage their states, would allow you to quickly see all of their inventories and what items they are each selling without having to constantly back in and out of the retainer summoning dialogue. You could have the portraits have a small chat bubble popup when you click or unclick or tell the retainer to do something (such as ventures), so that the dialogue doesn't just simply disappear.