Are you skipping all the side quests? You are probably supposed to do most of them, and get xp from them.