Since the maintenance done on Thursday I've had lag spikes for 2-3 seconds.
I've contacted my ISP to take see if there are any problems/package loss.
Next to that I ran checks on my computer to see if there is anything not working correctly there.

ISP: Ziggo
Speed: 160Mb/s cable
Ping in their network: 7
Ping ARR server: 90
Latency in game: 110-150

From what they saw there where no problems from me to the server.
There is no down load throttling either or signal jam.

In other words the problem is SE their servers in my case.
From my side/ISP side it isn't fixable.