I really think Extremes, Savages, and Ultimates being too hard is only a perception that really matters to say... Casual Completionists. I understand that it can bother people who have a need to complete every activity for the sake of just being able to say they've done it.
You really have to ask yourself for what reason you want to tackle that kind of content.
Personally, I those activities are really only for people who haven't felt challenged enough yet.