I was having the same problem with the 320.49 drivers. Downloaded the beta 326.80 and havn't had any problems at all. With the 320.49 drivers, i would get the display crash like 3 or 4 times a week, in game or just opening my browser.

My card is the gtx 760 but i would assume the beta drivers would work well for you. If not you can always revert back to the other drivers.