Because base damage affects stat caps, I would argue yes, it's better to use Ifrit's in every single situation, and adjust your gear and food accordingly.