Because they equate "time spent getting somewhere" with "immersion". Which is silly of course, immersion simply means "being immersed in [something]". Seeing as the ability to teleport is intrinsic to the majority of RPG game that incorporate magic, I'd say that we are pretty well immersed without creating a false sense of difficulty.