Only drawback from leaving in freestance is they of course use the skills from other branches but do not gain the passives from each stance if you speccd for it.