I enjoy being in a group of casual players doing pushover content and socializing while doing it. Throw in a tangible reward, and I'm double happy. Difficulty simply segregates the insane from the normal, and assures nobody has any fun.
Trust me, when you're in a scheduled raid three nights a week and getting screamed at by a 34 year old in his parent's basement for not being at the right place at the right time - you're not having fun. But many love to try to convince themselves they are.