People give me such a hard time because I don't wear...

People give me such a hard time because I don't wear dresses. What's that got to do with anything?