Considering Feo Ul has been established as being able to bother your retainers on the Source, I wouldn't be surprised if she still followed us around whenever we return to Eorzea.