I am experiencing the same issues on the same server. Not the machine, not the network, not the ports. Have a call in with my ISP, but if it is them that is causing the problem, they are singling out the Balmung IP address. Latency to every other IP address I've tried is as expected.