The way it was design is that when you have your pet out. Hitting RB will change it to the pet crossbar. What you should do is to use RB+one of the letter buttons to switch to that crossbar instead of just hitting RB. And only use RB when you need to control your pet. Just need some practice to get you set to it.