Seems like you are forgetting about times when we had to run away with our tails between our legs (more literally in my case) from Nael as he was about to annihilate us (such a perfect detail, that same move he uses when we escape through that aetheryte node is a move he uses during the fight

), about the time we only escaped the Amalj'aa by grace of Ifrit, we had even been captured before.
Or how all we could do against Gaius was watch as the investigators of the Circle of Knowing fought him only to have all of us completely blasted away by the Agrias's main cannon.
We are not as perfect as you make we seem to be (we as in the adventurers). And hey, being in the right place at the right time is what makes a person a hero.