I keep reading about how housing is too expensive and floods of people will leave if they don't lower the prices. Also Casuals claiming to carry the game...

I am a casual. FF11 did fine without droves of casuals. Trust me when I say this. I don't think you staying or leaving will effect things the way you hope they will. Yes the servers will seem less active to the people still playing, but server mergers usually take care of that.

When the game first launched there were too many trying to play at once, do you remember how reluctant they were to open more servers? And how they didn't open a million new servers, only what 2?

All MMO's should launch the same way, cause in the end it just ends up as the fans either way. Next up see what happens with Wildstar and TESO.