Hi, so I've been having an issue with the game since beta where I'll pretty much always get a solid 60FPS except when in towns, except for when I start manipulating the camera. Like I'll sit there with 60FPS, then I can move the camera in the tiniest of circles and the FPS drops to like 36. As soon as I let go of the camera it snaps back to 60FPS. Does anyone else have this issue, or know what could be causing this? No one else I've talked to has a similar issue, however they all seems to have NVIDIA cards too. Specs:

AMD FX-6350 @ 4.5GHz
AMD Radeon HD 6970 @ Stock, Tried both latest release and latest beta drivers, same issue
ASUS M5A97 R2.0 Motherboard
G.skill Sniper Series DDR3 RAM, 8GB @ 1866MHz
Western Digital Caviar Black 1TB HDD @ 7200RPM

This sounds like it could be a memory issue, but memtest86 had no problems. Maybe it's my video card? Any help would be appreciated!