Retainers are NPC's, why not allow our characters to marry them? Thus giving them access to different quests/ventures and access to our personal/private quarters. If anyone else already suggested this, apologies.