You won't fall, but you won't stay there either. This happened to me once and if I remember right I was returned to my home point (because as you pointed out, you might very well be flying over impassable terrain)