In EQOA, community moderators were also GM's who would log in on player servers & would handle any harassment or exploit issues. Sometimes within moments of the report. They could be visible or invisible to other players. (whatever happened to Sapphyra?)

FFXIV is missing that direct kind of direct presence.

I don't know about a player based "Eorzea Watch"... so many possibilities for problems on both sides.