As you found out, but just so others that may suffer the same issue is fully aware.
A possible fix for this situation is to:
Open the FFXIV config
Chose General
Go to Font Settings and enable "Use Windows system font" and click Ok

You can disable the Windows fonts afterwards, and the config should still work as intended.