I play on Chaos, with less servers than Aether, around 4 to 6 hours behind the rest of them, and it's not dead when I play. It's a bit hard at certain hours to get into a duty, but it isn't a ghost town. What you're experiencing is, as others said, the pre Expansion period when most of the playerbase takes a break.