We actually have a similar system in Chocobo races already.

If the group fills not within a specified amount of time, it will get filled up with NPCs.