There are third party apps that convert gamepad input into keyboard/mouse input which would let you press things on those hotbars with your gamepad.

Those might be against ToS though.