Only the party leader is given the option to search for replacements. It's possible that whoever was party leader clicked where the no button appears right as it appeared.
Also: Did you add the last person too your party before going into the dungeon? If so, you can't search for replacements.