Yeah, it's stupid how that works. Turn off the pet hotbar in the settings and use the "pets" section of Actions & Traits to assign pet commands to the hotbar.