I wouldn't say that this is an unpopular opinion at all. I didn't begin to dislike the character until after 5.3 wrapped up and it was all downhill from there. Letting characters bow out and exit with grace was like they did back in Heavensward with Ysayle and Haurchefaunt was one of the better aspects of the kind of storytelling we enjoyed in that era.

Despite however vocal some of his current fans are, there are a significant amount of people who are dissatisfied with his current treatment. If it does not improve, then indeed we would've been better off leaving him behind atop the Crystal Tower.