It's down to Duty Finder functionality.

It mixes hardcore with casual. There's no separation.

They don't mix well.

If they would just add an option in DF to choose 'hardcore' or 'casual' then this issue will be sorted.