Except that's not what we're there for. We're there on a search and rescue mission; the fact we're attacked the instant we step through the portal isn't our fault.
"Might makes right" is their rule, not ours. The ones that recognize trying to make a meal of us is a losing prospect don't attack and are left in peace. We're there to find and rescue Azdaja, not kill Voidsent or conquer their territory.