You can die of fall damage if you are aggroed by an enemy.
I remember the one time i fought that A rank mammoth near falcons next.He charged me off a cliff and i died to fall damage XD