Update: It seemed to fix itself after 24 hours and was fine for days. Perfectly smooth. But after WAY too many driver crashes in dungeons and trials, I changed to another driver. Now the FPS issue is back. I'm on Nvidia 344.48 right now