A counter to this would be Moon Keeper Miqo'te, which are basically the same thing lore wise. The males are rare and secluded, only coming to the clans when it's time to reproduce. They also gave Sun Keepers a similar storyline where the Nunh's are basically stuck back at the tribe doing administration work and can rarely leave their duties, with the Tia's helping them and having similar restrictions. A good portion of the Titan build up handles this, and even in Stormblood we see that the males of traditional clans have very little freedom unless they're outcasts. Those who have left the clans are generally freer and we already know Viera have been known to leave, even if they do so only once in a blue moon. (Though that doesn't account for those who left and reproduced. So a stable population outside the Wood is very likely.)
They already found a way to bend the lore for gameplay. Hell, they've bent the lore numerous times for the same of gameplay. It's already pretty well known that the lore team takes a back seat when necessary. So while I get your point, I don't see why this would be the hill they want to die on when they've caved on similar issues in the past.
