Your retainers can only get exp to your corresponding job, in other words you have leveled bard to 95 but haven't touched black mage yet, so the BLM retainer will not level.