Crashing upon entering towns

Been having this for a few days now, every time I try to port to or enter via the nearest region into the small town areas like Rhalgr's Reach and Idyllshire, I get an error and crash. I do not even get an error number, just a windows style tab telling me that the game crashed. This is after having to swap to DX9 because DX11 is downright broken to me, with weird pixelation issues that made gameplay impossible.
Once I load back into the game I have no issues moving about in the towns, but considering Idyllshire is pretty empty at this point in time and I even got these crashes in the middle of the night when even Rhalgr's was fairly low on population, I do not thing this has to do with overload.