I think you're right. I reduced my GDQ to 8, and I notice no difference, except the fan on my graphics card no longer starts screaming after 2-3 minutes.

One thing I have noticed since upgrading to the 580 is character and NPC models load quite a bit faster, too.