Just like in real life people do not like being followed. I guarantee you if someone you didn't like followed you everywhere you were going but never saying anything and just watching you...you would want something done about. Without the context from the OP at all we can tell just from the tell alone they are not only following but they are watching you.
I'm one that can generally hold my own and even i would be creeped out if someone was just following and watching me. Police would be involved immediately.