I'm not afraid of heights and I don't remember being bothered by it in other games, but something about actually falling in this game makes my stomach turn. Something about the motion of it just triggers me to feel sick in those moments, though I'm not bothered by being in the high place before that.

(There seems to be a common thread to these replies and I'm glad I'm not the only one.)