One possible thought:
Considering that Emet-Selch claimed to also be behind the Ronkan Empire, it's not out of the question that the ancient Ronkans were the First's Garlean-equivalents, who died out (naturally?) a few thousand years back. Their constructs even kinda look like stone-age magitek.