I was invited very early on into the closed alpha of FFXIV 1.0.
It was a mess.
After participating in so many MMO beta tests (First one was either FFXI PS2 beta or Anarchy Online, can't remember) I've found that the amount of impact testers have on the final product is directly related to interaction by the development team on the beta forums. EvE's beta for example had a shit ton of interaction by the devs and they incorporated our rallies for change into the golden master. Age of Conan's however, simple ignored the beta forum altogether, the only dev post for 3 months was the sticky that read, "Welcome to Age of Conan's beta forums".
FFXIV 1.0's beta forum was the later. There were 100 page threads discussing how bad the UI was alone without a single post from the developers. It was just as bad on the Japanese side. There were only a few stickies regarding planned changes, but there was virtually NO developer interaction what so ever.
At one point someone made a "Lets test how often this forum is read" thread that was page upon page of ascii art, just to see if anyone was even reading our suggestions. It was there for weeks. It was obvious no one was listening.
"Beta's are just for bug reporting" is a correct statement, but the forums are the direct line from the top to even describe exactly what the focus is. This time around you can see that clear as day. There is a scope of what the test includes and what exactly you should be doing. For instance this last phase was all about the Duty Finder.
I am using the forums as a example of the vast differences between the two releases, but would you be surprised to hear that what we saw in Alpha for ver 1.0 was basically exactly what was released as a finished product? We were not surprised at all.
This time around, each phase, each post on the beta forums has shown a very dedicated team of developers that are actively progressing the final product in each step. It is night and day and I have had my faith restored that there are enough people listening that any problem can actually be addressed this time around.