There's a bit of stuff about the Twelve walking among early humans, and basically every pre-Allagan kingdom being a theocracy.

Considering who the Twelve are all-but-stated to be, either the memories of Amaurot took thousands of years to fade, or the early Ascians were a whole lot more open about appearing to humanity.

Especially Azem, I'd bet.