Because it's too easy to treat raiders like some 1% social class of "haves", and through othering them like that they're now scapegoats for everything bad.