I can't think of too many characters I dislike outright. Maybe the racist Elezen from the Archer questline, who we're supposed to like despite him being a total asshole.
Not a fan of how some characters (Gaius, Yotsuyu, Emet-Selch, etc.) inspire all of this "They did nothing wrong" parroting in the fanbase, though.
Marcette?