Speaking as another hetero male player with a female character... some people have weird tastes, and you just kind of have to accept that. Don't let it bother you so much.