So I've been playing a melee up untill now when i decided to level con for the spikes buffs. Well i decided i like casting more so i figured I'd just reallocate my points to be more caster friendly.

Apparently you can't only reallocate all spent points. Is this going to gimp me in comparison to other players?, I'm only physical level 15. Should i just re-roll, or is there another way to move the points around?

Would kinda suck to have to level all the way up again. It's also kinda nice to level up with defender for solo.