Swapping between jobs would not affect minions or anything else, a WHM retainer brings the same items as a PLD one, so there's no reason why they should reset their level.