Not happening to me or anyone I know on my server.

It might be something in either your data center, your particular server, or your location in relation to your server.

In other words, no this isn't happening to everyone and I wouldn't necessarily say it's a "common" thing, some people might have latency issues but I'd say that's the minority not the majority, and a lot of the time it boils down to personal Internet issues and not with the game itself.