Weapons take damage from attacking and casting spells...so yea...it's going to drop if you spam spells.