Main shout channel and connected wards is the way to fix this. I don't care if this breaks immersion for some people.

I personally have already moved to Grid and assembles mostly everything there because Ul'dah crashes alot and have silly loading times.