I don't "speak in character" but otherwise, I do that too.
I also like to emote at NPCs or locations when it seems appropriate. Bowing to important people, 'paying respects' to the dead.... it just feels right for the story and my character.
(A lot of extra dialogue goes on in my head as well, anything from talking to shopkeepers to important emotional moments.)