Yes - this seems to be consistent so far - on chars bellow 50 your retainers are limted to lvl-5, on 50 chars you can have 50 lvl retainers. If it's intentional or bug is another question though.