If they pull for you without your permission, just report them for griefing. It is your job to grab and maintain agro not theirs. It is rude behavior. If they wanted a speed run, they should go in with a pre-made.

I personally hate being rushed and I like to take my time and enjoy myself in the dungeons with the people I play with regardless of what role I'm playing. It creates more opportunities to chat and make friends that you otherwise wouldn't have. This "go go go" mentality kills that fun. People in this thread acting like somebody forced them into the dungeon and they can't be in there a minute more than they should. Perhaps you should find other content to do if dungeon content is that boring to you?