Even if your server has only 5 ppl online this wouldn't affect DF queue AT ALL. DF system is server wide. DPS queues were always big and it really depends what dungeon you queue for and what time of the day.