We can say deserted but just cus you don't see people wandering around the area doesn't mean the houses are not in use. Probably safe to say that if they do go to the house they instantly go inside, tend garden if need be and gone again, not much reason to hang around a house unless your taking advantage of the bonus crafting items but even then, that is inside.