I think it's possible to believe that Varuthy was both a victim of Emet-Selch's and his fathers machinations, and also a cruel, bullying sadist who ruled through fear and enjoyed throwing people off the balcony when they annoyed him.

Those are not really mutually exclusive ideas.