A lot of the invisible walls cease to matter when you can fly, I found. Once I unlocked flying in Western Coerthas, I was able to land on places that were clearly brown on the map - no foot traffic allowed. There's a dotted line on the edge of the map that represents the flying barrier, but everything inside that line is fair game.