You can see it. If you go to the "Ifrit Bleeds, We Can Kill it" quest in your Journal, under the quest summary it will say "Quest Item: Inferno Lamp" if you've got the lamp.