I'm just annoyed it's tied to your character's actual level. If you want to send your retainer out as a miner and max him out you also need to level miner to 50