I have no hard evidence, but I'm pretty sure you're PVP rank affects your queue time as well. Last summer, when I was obsessed with Frontlines, it was VERY noticeable how my PVP friends (same server, same GC, same data center) would get much faster queues than I would when I was over rank 30 and some of them were just starting out (and lower than rank 10).