I don't remember having any trouble there at all, in fact I think the npcs were always invisible even if they got seen.