Fast travel in any game is definitely something that is immersion breaking in my opinion, I will grant you that.

However, the alternative is having to physically walk everywhere like back in FFXI (the few teleports notwithstanding) and given the option, I'll stick with the immersion breaking fast travel because it's just far too convenient.