You are aware that with general drawing quality 10 your resolution is four times higher, right? And Anti-aliasing increases the rendertarget resolution even further. At some point the memory requirement is just mad. And are you sure the anti aliasing via nvidia control panel even works? 'Cause afaik it doesn't.