There is no quest marker because talking to that guy just takes you to where the quest is. I guess the main reason there isn't any marker on the map, is because they don't expect people to leave without the next quest.