I believe its possible this might be your ISP/network configuration problem, not game server problem. I had this happening here a few times too (here we play in 3) and, when we started doing stuff at heavy information areas (crowded camps or when there were in large groups) often one of us had R0.

My very first guess would be you check if you have a proper broadband speed for shared connection playing.