Yeah, but then they're just going to hang out directly in front of your house, or in front of the market board, or whatever. If a player is harassing you, call a GM on them. I can't imagine that this problem is widespread enough to warrant adding a new feature for it.

Although locking your house should remove anyone who doesn't have shared access, if it doesn't already.