It's all just Gridanian Propaganda to keep the Hearers in power! Don't believe their lies!

. . . Though it's probably more to do with how the Elementals only seem particularly strong around the Black Shroud. Elsewhere, like Sharlayan where Y'shtola learnt her Conjury, you can probably take aether from the land directly without having to go through the middle-men.