I use Japanese audio with the English client, and there are quite a lot of situations in which words like brother/sister/friend etc. are being being sad and I recognize them, but they're not even mentioned in the subtitles, thus altering the actual meaning.
I understand not being able to translate humor/word plays etc. 100%, but such a large difference is irritating.