I tried to do exactly this shortly after finishing the questline and was surprised to see you couldn't enter via explorer mode. It's pretty disappointing, but you can use your Return spell once the raid is over to go back to the start if you really want to look around, though that's definitely a lot more inconvenient of a process.