People think it's harder than it is. I don't think I've ever done it with more than about 20/22 people and I've never rescued any fewer than 5 prisoners. Lowest was 16.
So people see that there's less than 24 people, incorrectly think "it will fail" and leave.

The reason why there's less than 24 people? Not enough incentive to re-run it.