There is no need to mention chromosomes. Biologists distinguish male from female in a sexually reproducing species based on degree of parental investment. Females have high parental investment. Making an egg is costly and the female makes relatively few of them. On the other hand, males make many many sperm and thus have low parental investment. Sexual dimorphism is simply specialization around these facts. Females make eggs. Males make sperm. A woman is a human female. And yes, they might argue that some women can't have babies or don't produce eggs bevause of an injury or genetic disease. They are still women, but defective ones. If not for the defect they would be a reproductive member of the species