Excluding Players from Ultimate Savage is Not the Right Move

[KDSilver]

its not worth the effort or the set up, and the raid community is pretty toxic.

That's not true at all.
There are as much toxic people in the raid community as in the casual one.
And as my personnal experience, in game or even on the web in general, casual tend to be even more toxic than raiders themselves.
Even on this raid community, those who are insulting and blaming everyone aren't even those who play very well.

I know a lot of very good raider players who are very helpful (granting help for kills, giving advices), patient...

So please, no.
Yes it exists, because well, "human", but it has nothing to do with raiding itself.