Are you holding down the button? The dungeon version of the prompt was changed so you have to keep it pressed down in order to release.