So under heavy loads. What's your GPU? Do you happen to know if there are any beta drivers out for it?
That honestly sounds like a rendering panic. Voltage values may be off or the driver may conflicting with other software.
Can you raise the voltages on your cores and see if you stabilize? Remember, push them up but be careful as you can fry/short/burn the cores if pushed too high.