Problem here isn't with the system, it's with the player you kicked. Report them for harassment and refuse to boot them, inform them if they want a certain job setup they can use the party finder instead of wasting other people's time, they gave up every right to be disappointed with the party the moment they clicked "join queue".