I've been getting really nasty 5-10 pauses during battles, particularly boss fights, but it's probably been happening all the time.
My gaming machine is also a virtual server. I installed the Hyper-V role right around the time my issues started.
I just removed it and have immediately seen my issues go away. Probably an issue with the network filter drivers that are installed.
Uncommon scenario, but I thought I'd share.