^^^This^^^Never understood the whole "If you don't like it don't use it" mentality on this particular topic. There are many reasons why it's impossible to not use it.
1.) EXP Parties you're in will use it to get to a particular area. Thus you used it.
2.) Linkshell members are going to use it to get to particular areas for raids and other content. Thus you used it.
3.) The imbalance in not using it compared to those that do is so staggering that you would always be behind your friends/other players in terms of progression due to time spent on walking compared to time saved teleporting. Which wouldn't happen anyways because you're not going to tell your friends "I don't like Anima Teleportation so you can't use it while we do stuff together."
Head out of rear end people. This is a legit problem. Teleporting everywhere, while nice, removes you from exploration. Which sucks. There needs to be other limiting factors on this other than time to regenerate anima. I think having to visit the Aetheryte crystal or node to be able to go there by teleport at later dates is a good suggestion. It makes people explore the world and earn the teleport to that camp/area.