New players should do what they want- either keep up or go idle at cutscenes.

Either is a valid option. Attacking the party majority for carrying you isn't going to make you look any more of a victim, as you are reaping the true benefits in the expectations of Duty Finder.

Don't like doing what the majority wants to do? Party Finder is always an option.