I believe it's mentioned somewhere (or maybe just a long ago speculation thread) that the Elezen who did not want to make peace with the Hyur (who had recently came to Eorzea) left Gelmorra and later founded Ishgard. Funny thing about mountains and cold, people can start having visions due to the cold or lack of oxygen.