The crashes seem to be a result of the new collision detection system.
If you run into people who have been idle it will cause the system to shutdown eventually.
How did I figure this out? After thinking about it and having 0 crashes I decided to start running into idle people as a test (Always avoided people). AS SOON as I checked the auction house after doing this I crashed.
Go ahead people try the new anti-collision system then open your inventory do a few things or open the auction house. I think this is what's causing the problems. Running into NPCs followed by Idle players seems to make it crash more.
Update:
Does anyone know if the Japanese player base are having these crashes? If they aren't that would explain why we haven't heard from the developers about the real problem.
After closer review, It seems that swapping a lot of gear and the blinking effect might have something to do with it. It would explain why I crash less then others.