In my opinion, physical levels are fine as currently implemented. My only change would be for the game to remember our stat assignments individually for each class and automatically shift them when we change classes.