Comcast has a bad rep as an ISP. I would try a VPN (mudfish, pingzapper etc) and if it clears up it's most likely an ISP/route problem. I'm on east coast and my ping to the server is usually around 90-100ms and near 0 packet loss with no VPN.