It wouldn't be hard for SE to make it so that you could invite a person into a dungeon that was in progress. Since Linkshell and Company chat work while in a duty then it would be no problem for them to enable /tells and invites.

If you get a party invite from someone in a duty once you accept just have the commence button pop up with the duty info.