Standing around in battle isn't incurring any enmity.
but once you have enmity, it doesn't just go away.