No it won't. With fewer people in the queue, the queue needs to put together fewer groups before getting to newer people in the queue.
An excellent counterexample of your point is the period within the first hour after servers come back up and the number of logged in characters is low. Queues for some content will pop faster in that case.