I've seen people ask out of genuine curiosity but have never got the impression that they were offended in some way while asking. And usually an answer of "oh I just like having different looking characters" is good enough unless someone is specifically trying to pick a fight for whatever reason.