Side quests aren't meant for levelling. They give a bit of token xp and an infrequent gear coffer as small appreciation for those who are interested in doing them. If you aren't interested in the lore, you can just ignore the yellow quests on the map.