While the Ishgard/Dravania conflict has definitely been set up to be mired in shades of grey, it's a bit of a leap to propose that the Dravanians might actually be the good guys. Sure, it's entirely possible that, counter to their own historical beliefs, the Ishgardians actually drew first blood. But you have to remember that as dedicated to wiping out the dragons as the Ishgardians are, the reverse is also true. Nidhogg destroyed an entire town, killing literally everyone in it except the single survivor (Estinien) rescued by Alberic. Keep in mind also that the Dravanians don't hesitate to also magically enthrall people, driving them insane and making them serve the Horde.

Whatever wrongs might have been committed against them, the Dravanian Horde does not possess the hallmarks of a morally good faction.