When you open the retainer menu, the option in the corner is there to organize the retainer order. Just move the ones you don't want to the end.