Miner/Botanist are the ones you want to have more of imo and I need to eventually swap my retainer classes around so that I am not using 4 combat.

Right now I've got 4 combat - 2 botanist - 3 miner - 1 fisher.