The funny thing is people call phobia when we disagree about a matter of aesthetic.
Clothes for "women" are supposed to be made for "women" body shape as clothes for men are supposed to be made for "men" body shape.
It's not because you find a clothing pretty it will fit you. You don't believe me? Then why so many people ask for advices to dress if it is false? Why so many magazines give advices to choose the right shape of clothes depending of your body type?
Women clothes rarely fit men especially when the cut is made to valorize hips shape (without telling anything about hairy men's legs).
Even without considering gender, some clothing will look vulgar or weird one some people when it will look cool on another. Maybe it's unfair but that's the life.