I'd agree. They should make it so the party members you queued with are grayed out (like what happens when you open the commendation menu and party members leave)