Except someone bad in Sastasha can actually slow you down somewhat.

The reason they made the large-group raids in this game the easier ones is precisely so that slackers won't be a real hindrance.