I've just run into this exact same issue myself. It seems like a minor (but very annoying) oversight that you can't just pick which specific hotbar appears in your WXHB, regardless of input method. The standard hotbar displays seem like an unreadable mess after several hundred hours comfortably using only the cross hotbars too. I'll have to do a lot of customisation to sort this out, which is fine, but I really shouldn't need to. Even just a third XHB would solve this instantly.