No. I didn't actually do it (because I was happy with the stats I chose), but it looks like you just speak to Ulan and reallocate. You don't have to get sands or Umbrites(!) again, or anything like that.

She sits in Idyll with an exclamation mark over her head and it says you can reallocate if you want