Go to your FC house, make sure your room is empty and bring up the social menu and select housing, go into Estate Settings, then select Private Chambers, there'll be an option to demolish your room (make sure you're not in it when you're doing this, it won't work). After you've done that, you can simply leave your FC normally.