It's hard to say what the issue may be. With the amount of information provided, we have next to no indicators on what the issue could be with exponentially high variables.

Do you have any more information? Is your connection hardlined or wireless? Did you tracert or pathping the patch server IP to check for bottleneck/packet loss? Running anything in the backround? Throttling? Did you reboot your router or flush your DNS cache? What's your ISP speed? Has it always been like this? Does the speed fluctuate? Are you on PC or PS3? If PC, what version of windows? Are you behind a VPN or firewall?