I've seen the number go down, but never increase. Maybe alt tabbing acts as a log off? Then when you alt tab back in it requeues you? I've been 11th in queue before and in within seconds, and have been 2nd and its taken a min. So not really sure how it works...