Weeeell personally I did the HW story asap because I wanted to know what happened..
but yes in dungeons I always wait for people because I know not everyone is speedy like I am. ESPECIALLY since I love the story and I want other to experience it the way it was meant to.. (Honestly I don't get it..speed through a dungeon and be bored again? Erokwhateverfloatsyourboat).

Non-spoiler hint, the only in-dungeon cutscene is about three minutes long. Let people wait for you, especially as a scholar they can't finish without you so...

If that still stresses you out a bit, grab one or two friends for the story stuff.
If that still doesn't work come to Lich I'll run stuff with you, hehe.