I'm a 24 archer at the moment, with str, vit and dex pumped. But I've been wanting to try out the casting classes, but I don't really want to re-allocate all my points into the caster stats, how much of a disadvantage will I be at if I don't? Will I be supergimpy, or just slightly below?