For some reason I noticed that it involves where you accessed your retainers. For example, if mine are housed in Gridania, and I accessed in Gridania, they will say one thing, but if I accessed in Ishgard, or some other city (retainers still being sent to Gridania MB) then they will say something else.

Anyway, nice little polish fix, thanks Corvinoobus!