This was my main complaint while going through the story as well. All of the dungeon sequences in the story are so rushed and anti-climactic because you're forced to play with other people who only want to blitz through a roulette. It was a terrible idea to force group content into the story.

Most of the time it doesn't even make sense. You're about to come face to face with a primal; you're the only one can do this because you're the only one with the echo, but wait... 3-7 other echo users materialize from nothing, fight the primal with you and you never see them again. Just nonsense.

At least once you get to Shadowbringer these become solo instances you can run with AI, but that's a long ways off.