It sounds to me, that the CPU overheats and then it throttles the clockrates down to prevent damage. If your CPU fan is clean and the problem still persists, then you should renew the thermal paste.


Cheers