Along with the whole you're all savages and lower than us only because we have better tech as part of the reason. Right now I wouldn't be surprised if we find out that the races that did the "bullying" of them weren't told to do so by the Ascians. As it feels like it came out of the blue and then just stopped after they were pushed into Northern Ilsabard. That and no one else so far who lives around them seem to recall or have records of that happening. Obviously it must have as no one refutes that it didn't. That is until we learn more if we learn more.