I felt the same about switching from Midlander to Roe.... Thought I'd "not feel like myself" and that the connection to my char will be lost. Especially cause my Midlander basically looks like my real self. Much, much happier now and wouldn't change Roe for anything :3 (except maybe if they introduced a Qu-like race <3 ).

As for your torubles, I'd say go with the gut feeling. Which of the two makes you smile? As which race do you like roleplaying (not to be taken literally) and try to identify whether it's just nostalgia or guilt that you feel.