It's a shame you don't enjoy him OP, my SO really dislikes him too.
But I for one enjoy the comic relief for the most part, they also learned to not link fights required for trials etc to him a while ago so you can just ignore these quests if you like.
You cant please everyone.
