I'm essentially in the same boat as the OP. I like doing things with my friends and we're few in number. Going into a dungeon with two or three, level appropriate, should not take away your XP. Yes, if you enter at a high level you shouldn't get XP. Of course not. That's ridiculous. Going in at a disadvantage should not penalize your xp gain.