To reiterate, this is like trying to complete a quest in the Rising Stones while standing outside the entrance. Sure, on the map, it looks like the quest marker is in Mor Dhona. But that's because it's telling you to actually enter the separate area where the destination actually is.

Just because you're "at the quest marker on the map" doesn't mean you're at the destination.