Restrict teleporting to be from one crystal to another only, and you can only teleport to camps you have already been to. XIV was ridiculous in that it let you teleport to anywhere at any time on any job, and you could even teleport other people to camps they have never been to which is straight-up hax.
Aetheryte camps and nodes were pretty damn commonplace in XIV so this shouldn't be an issue for anyone. I really feel this is such an easy compromise but don't see other people saying it too often. Could even keep the return option around but restrict it to a 1 hour cooldown or something.