You can. Points can be re-assigned at any time, but you can only do a certain amount in one shot can't re-assign below your starting amounts related to your race.