The last 4 times it has happened it was when I interacted with something part of the End Walker MSQ. Ex. Clicking on the Main Hall entrance, clicking one of the NPC's to have them follow me, etc.