I'd imagine it has a bit to do with it forcing you into an instance after 10 minutes has passed. Something probably messing up and shoving people into their own instances after 10 minutes since people cannot join part-way.
The raid already scales to the number of people in the zone. Doing it with 8 people is very doable. I used Party Finder to find a group to clear it a few times about a month ago.
