I've noticed little change in dungeon speed when everyone pulls their weight.

You sure you aren't just getting folks who are bad at pressing buttons?