Lyrinn and Codek put it very eloquently.

It's not that there is anything specifically wrong with speed runs themselves, it's the attitude that generally comes with the speed runs. Usually this means that the speed run is shoved down someones throat whether or not that person can handle the pace. It is because of that attitude that the stigma against them formed.