Latency more than 130ms

[Kallisti]

ISP can't do anything with routing outside his domain.

They can change how they are routing traffic to the server. You need to talk to them, as it has to be your end/the way you are being routed.