Not sure if many traitorous Braves stayed on with Ilberd after losing backing of Lolorito. Sounds like only Yuyuhase and Laurentius, maybe, judging on how close to Ilberd they were in Halatali.

Rest may have become footpads. Or stayed on and helped with organization of Masks, believing that would help give somewhere to go. Neatly fixes hole people keep poking at, "How get so organized so fast?" No way to know for sure.