How about having it so that the face can cycle through various 'neutral' expressions with hints of happy, bored, annoyed, etc just as with the idle animations, except this would be at all times unless disabled. Then you can set a character mood option that would modify that expression cycle to match the mood selected. The expressions would not be as pronounced as the emotes themselves, but it would allow you to have some variation beyond the static neutral NPC look we have.