We knew about their previous existence due to a sightseeing log entry in 3.1. The temple in Azys Lla is theirs. My guess is the Allagans either purged them, enslaved them or broke them to the point that any remaining members are in some lost corner of Meracydia.