Hmm, I always had this issue and I am pretty sure it's latency related. I am playing from the EU though..