Getting a better GPU will most likely raise your fps a bit. But the GPU always needs a potent CPU filling it with information :P
Getting more RAM won't change anything. The game can't get past ~1.8GB usage.
What also helps (especially in towns) is a fast HDD.