The only thing you really lose is gil if you have a crazy amount of it. Everything else gets transferred no worries. Server data is separated from Character data.