I even have on my housing plaque saying "come on in". I snoop around others' houses all day.
If they don't want you in they can lock the door.