Nevermind.

I found that simply hiding the cross hotbar in exploration HUD is just fine and reduces clutter even more. The cross hotbar still shows up when you use it, so that's just fine. Perfect, actually.