What would be a mitigation mechanic that is fun and somewhat challenging for example? Outside of certain action oriented games with active blocking/dodging I have yet to see one.

Maximizing damage additionally to mitigation at least increases the low skill ceiling that comes with tanking imo.