If one made a comment that a black person sounded too white, I think most would agree that is a racist comment. Likewise saying that a trans woman sounds too manly is pretty implicitly transphobic.