It wouldn't be a good world if it wasn't grey but the events in the current Era seem to be mirroring that of the 3rd Era. Which I still don't want to spoil anything so....read at your own risk.
During the 3rd Umbral/Astral Eras (can't remember exactly which), there was an empire similar to the Garlean Empire called the Allag. They had taken over even more of the world then the Garleans and not only had mastery of Magiteck but of also magic in general as this was about the time that the schools of Black and White magics where formed. So even if they are doing a "better job" now of asserting control, it may just culminate in an arms race that sends the world back into an Umbral Era. Minfillia even states that people, beast tribe or no, turn to "gods" and "higher powers" when they are desperate and the Garlean Conquest simply fuels these feelings of uneasy and desperation.
It is also made quite clear that we, as adventurers, do not originate from Eorzea. This could mean you are already playing a "Garlean Empiral". One who's homeland was concurred. It could be that there are also very few pure-blooded Garleans in the army let alone the Empire. They do originate from an island-nation.