Yeah - it seems that while your corresponding class is bellow 50 the retainer's max lavel is capped at your level -5 ...