Seems you've done everything but check your temperatures.. which is my guess at what's happening. Overheating and core throttling, causing the slowdown.

Post back with CPU and GPU temps when idle and then after running the game and experiencing the slowdown so we can see if this is the case.