You can remove all your files if you want. The only reason to keep them is if you want to use your character in the next benchmark, which is scheduled to come out after Phase 3 of the beta (SOURCE). Your character data for the game itself is backed up to Square-Enix's servers, so you don't need any of your current game data.