Inspecting other players should send that player a warning/message

[OM3GA-Z3RO]

But I'll bite

If you are playing on a PC.

grab the Peeping Tom plugin. It will tell you who is inspecting you.

If you're on PS then.... oh well tough titties.