You end up dueling as part of the MAIN quest line. I don't see a lore reason against having dueling in the game.

If people want to have a fun little duel SE should let them.