That's right, the level of your Main Scenario Quest is what really carries relevance because that's what blocks access to most things.

Most level 50+ quests would actually take you into Heavensward areas and may contain story that references the ongoing Main Scenario Quests of the same level.