I think a good solution would be to eliminate the market wards area, use that area for "personal housing" since no one wants to call it a mog house. Allow us to summon and interact with our retainers in our "personal housing" and when you enter that area you have the option of going to your space or searching retainers and making a purchase that would be delivered to your housing area. The only thing I'm on the fence about is history, while extremely handy for making sure you are getting a good price, does allow for a lot more manipulation of the system and the economy.
