They're not leaving, they're getting prioritized. It might show you at 1/1 healer because that's what it's building right now for something, but if enough people join up where all they need is one healer, it pulls that one and places them in that party. Duty roulettes have made this even more confusing/pointless as the temp parties really don't mean anything.