Could always make trash pull into the boss fights if they aren't cleared.

Sure a good group maybe able to clear it like that, but it'll make the fights more difficult and they aren't able to just flat out avoid trash that way.