also i think SE balanced the game for the dungeon but more for Hard Content.
nerf something for the easy dungeon would be a mess for the hard content.
Also who care you are speed running or not ? it's a choice.