Their lore already instates that they're not an aggressive tribe. Making them an aggressive tribe would go against that. There can be Goblin bandits or whatever, similarly to how there are hyur/roe/miqo'te bandits, but overall they're pretty calm.

But hey who gives a shit about lore so long as I get my fix of nostalgia, am I right?