The problem may be that your waiting by the entrance
most people shout in town then go to the dungeon when they have their party