I have no idea what a toxic casual, is but randoms shouldn't be dragging down a dungeon or trial run more than making it take a little longer or adding a wipe or two. If it's that much of a problem, grab someone from your FC to play with when you do story or roulettes.