Changing the dialogue just changes the dialogue, not the written text I think. Because you are on English client it will be in English(voices default to the client). You will need to buy a Japanese version of the game to play fully in Japanese. It is very hard especially to read all the Limsa Lominsan dialogue. I think the localisation team just gets carried away with the RP.