All visible houses and yards could be part of the same neighborhood instance, just like the yards are now. No load screen delays when entering any yard or house. When you pick another house to view from the placard, then there's a load screen while the previous one is removed from the instance and the new one is added.
People in the yards should be able to see everything on the street because they're part of the same overall instance. Sort of like virtual memory.