You were right. Installing the drivers solved the issue.

I will write it down for posterity:
The Logitech G110 Keyboard needs the Logitech software to work properly on Windows 8 and above, for games like FFXIV and WoW.