I find it rather insulting that if you send both your retainers on exploration missions once a day, which is perfectly reasonable, you end up exactly one short of the challenge.

That's like a giant middle finger to the player.