You only gain experience in level 50 dungeons upon completion of the dungeon.

It's a bit wonky. You would think you should get some kind of exp, but I suppose if that was allowed people would just spam the current level 50 dungeons until they hit 60. So perhaps that's why they didn't make this work that way.