I don't know where the latency problem is coming from.

But I do wonder how many people saying "Work with your ISP" have tried working with a commercial ISP to solve a routing problem for a single program.