I've fixed the issue. My first hotbar was cycled to the third one.

I'm not sure how I managed to do that though, since I've had the both the arrows disabled as well as having those hotkeys unbound for weeks.