From what we've seen, even their bases have Latin names. Castrum Novum, for example.
It also hit me that the White Raven's theme is sung entirely in Latin as well. Could simply have been an aesthetic choice for the song to fit with the theme and merely a coincidence, or maybe the Garleans do literally just speak what we would call Latin.
Which would be awesome.
