It would probably cause a bunch of loading issues. While, it would be pretty neat to be able to have your minions on roam in your house, it probably would take a lot of work to make it happen. Housing seems to have enough problems, and until they fix the current stuff might be best not to add more possible issues.