If you are queuing that long, maybe too many people have you blacklisted? Or you blacklisted too many?

Or are you queuing for something rarely done like the level 40 8man guildhest?