Oh you're on Lamia, that's why. Peak hours on the server are usually around 9PM EST- 11 PM EST at best on weekdays. Hardly anyone does FATE grinding on weekdays, and usually weekends are your best times to level up jobs. Really, the server is extremely casual dominated so most will rather solo queue for a dungeon and wait for an hour or so to get in than derp around on FATEs. I leveled my ninja purely on FATEs but that was around the 1st or 2nd week of 2.4 so there were still tons of ninja FATE groups running around Coerthas at the time. Now the hype has died down players are back to logging in once a week or so to cap poetry and calling it.

Lamia isn't exactly highly populated with actual players, so you're going to have to either grin and bear it or find some friends to run with.