The 'basic' fixture set is Roof, Wall, Window, and Door, so you'll need to have something set in all four of those component slots in order to unequip an all-in-one housing set.