Maybe allowing cafting while the retainer's inventory window is up. Of course would only work if the retainer is summoned