I have underclocked my GPU a bit more and its been helping. Not sure if the card was auto overclocking but when I have the GPU underclocked to this degree its been more stable. Seems like a weird thing within the game as no other games I play have this issue.