It's always something to consider, hell have your retainer act as the "Mog" of the house keeping all of your affairs in order while your out adventuring.