Whitegate causes me to lag....

I can play 14 an 11 at the same time... but once my 11 char is in Whitegate, it starts to lag a bit.