It only takes 3 people to form an FC. Instead of joining an FC, just form your own. The other people don't even need to remain in your FC once formed. You can be an FC of one, buy an FC house that you could have all to yourself, and not be left out of any content.