You don't really have to restart. Keep levelling and eventually you'll get the ability to swap classes.