I'd imagine there's a lot of people specifically running that one now just for the esos.

It's your fault if you keep skipping out on it -- if you're all at its item level cap (which will be the case most of the time if you have no new players) it runs about as fast as the other dungeons anyway, and if you're not, chances are you have a new player, which means even more esos.

The only thing that really makes this dungeon take long is all the people who leave it for stupid reasons.