Yeah the fact that melee DPS has no downside really causes all kinds of balance issues. Likewise casters had their need to cast (and hence abort casts when having to move) eroded so much it hardly matters any more. Plus like you say, fights are designed to allow full uptime for both casters and melee anyways.
