They might be loading faster, seeing the gear/HP of the people there, and then choosing to leave because they don't think the run will go well.

I'm not saying this is right, but I think this is the most likely scenario, and I have personally witnessed it a few times.