In case anyone else needs it, the correct check box for this is "Pop Up Help" (not exactly intuitive there) in Character config. I thought this was for something similar to the Active Help boxes that crop up in the beginning of the game, so I had turned it off.