I don't believe it's on actions, you lose durability whenever you gain XP (this includes being capped at level 50, you still gain XP it just doesn't get shown since you are capped).

It's important to remember this if you decide to run dungeons like Castrum Meridanum where you might have to defeat a lot of enemies.