Instead of restricting players into 4/4 parties or 8/8 why not create events that scale based on number of players in the party?

Sure it would be more difficult to balance each encounter, but what about those times when you want to do Ifrit but can only manage 6/8 members?