It appears to be an issue with NTT doing traffic shaping on their west coast node connections during US primetime hours. It starts up every evening around 7-8 and ends right around midnight.

SE, you guys need to address this with them.