Audio popping issue

[minopoki]

I don't want to repeat myself nor spam but I advice you all to try this out if you truly have horrible issues with your sound. It doesn't take long to try yet it might save you from long lasting annoyance.

Well, I hadn't done it before because I was scared to sh*t of damaging my hardware, but I finally did it, and honestly, audio stuttering seemed even worse, happening more frequently.

So, explaining the situation: my AMD FX-8370E usually runs at 3.3GHz. I first changed it to 3.6GHz and it was no good. Right now I'm at 4.1GHz and no good again. I really don't intend to try higher speeds.

One maybe strange thing is that, although overclocked, my CPU Cores stays most of the time at 1.4GHz, even when playing the game, and occasionally, they change to 3.6GHz or 4.1Ghz.
Don't know if that's to be expected, or if some configuration from the BIOS is preventing it to run at maximum power (I disabled cool n' quiet).
Is this how it is supposed to behave, or is something not right at my environment?

The image below helps to illustrate the situation:

EDIT:
So, additionally to Coll 'n Quiet, I also disabled an AMD Turbo CPU (or something like that) option in the BIOS, and now, when overclocked to 4.1GHz, my CPUs don't stop at 3.6GHz anymore, they just switch between 1.4GHz and 4.1GHz.
It really seems that, when they are at 4.1GHz the stuttering doesn't occur, although, I can't be sure if it fixes 100%.
The problem is that, most of the time, me CPUs stay at 1.4GHz. I have even set Windows power options so that CPU minimum speed is 100%, but it still stays at 1.4GHz most of the time.
Although I fear for my CPU temperature, I would at least try to test how it would go if I could keep it at 4.1GHz for long time intervals, but I really don't know what to do...