I have an EVGA GTX 970. I used to have that exact same problem. I installed the hotfix driver 53.38. Hasn't happened since (its been a week or maybe more). No crashes of any kind either.

I also flashed my bios to the latest version.