Sky Pirates (60) Alliance Raids are pretty much as fast as 50 by now. Ivalice (70) isn't that long, either. Nier (80) can take significant amount of time, but mostly because it's still fresh, not because it's particularly hard to do.

Also, if anything, there is a way to avoid higher level raids in roulette, and looking at how frequently I have Crystal Tower in my roulette - people do this a lot.