If things like WTFast and battleping help than the latency problems isn't caused SE servers but caused by one of the hops your connection takes to get to the SE servers.