As long as you have a current router around 1-2 years old at best, it is not always the router. It is the way that the game handles the packets. A good "N" router will be your friend, and they do not have to be expensive.

Tha being said, we have four computers active on our internet, and when 2 are on the game, we can see increased drops. Very frustrating