Does summoning the retainer for storage & market sales duty put their hunter/gather/exploration on hold?

Meaning... over the course of an 18 hour venture, I summon the retainer 6 times, for 5 minutes each time, will the venture complete 30 minutes later than originally anticipated?