That idea sounds okay in theory, but wouldn't work in practice.

The dungeons are balanced for having only the abilities you can at those levels. Even if they reduced the power of higher level abilities, they would have to reduce the power so low that there would be no point in having them at all. Either that or redesign the dungeons.