I usually carry on with 3 people if it's just a DPS.
But if we reach a boss AND wipe to it, it's time to cull our losses.