...I don't think there's even an option to restrict members from leaving free companies. At least that's what I think when I last editted our FC's settings.
You sure you went to the Info tab, and hit "Leave Free Comapany"?