You can't really blame players in either side for this issue. It's poor design on SE's part.

Personally I don't even queue for Main Story Roulette because I don't want to repeat the same lengthy cutscenes every single day or deal with the related cutscene drama. The bonus isn't worth it. Sadly, if everyone else did the same and avoided it, you would have a much smaller number of players queuing for these dungeons. That results in absurd queue times for new players. Either way, there's a complaint and no solution will make everyone happy 100% of the time.

I do agree that if you absolutely have to watch every cutscene and are unable to handle the rest of the party moving on without you, then it's best to make a group in Party Finder for that purpose.

Duty Finder is generally used by people who are grinding tomes, and especially with the new relic quest, people want to grind them quickly. I find this to be equally as understandable as wanting to enjoy the cutscenes.