Any size house is good for an FC, aim for a small or medium one if the large one fails, you wont lose out on anything FC wise other than gardening plots small 1 medium 2 and large 3.

You can later on relocated to a bigger size FC house later on, the workshop/airships/submarines/FC member rooms will follow.