Socius Sociological Research for a Dynamic World · 2020 · 93 citations · 50 references
Social SciencesComputer ScienceGender StudiesComputer VisionMachine LearningStereotypingBiasFairness In Machine LearningGender BiasGender DiscriminationGender StereotypesStereotypesAutomated Image RecognitionAutomated Stereotype DetectionBiasesGender Prejudice In MediaGender Stereotype BiasGender Stereotype RepresentationLabels
Image recognition systems offer the promise to learn from images at scale without requiring expert knowledge. However, past research suggests that machine learning systems often produce biased output. In this article, we evaluate potential gender biases of commercial image recognition platforms using photographs of U.S. members of Congress and a large number of Twitter images posted by these politicians. Our crowdsourced validation shows that commercial image recognition systems can produce labels that are correct and biased at the same time as they selectively report a subset of many possible true labels. We find that images of women received three times more annotations related to physical appearance. Moreover, women in images are recognized at substantially lower rates in comparison with men. We discuss how encoded biases such as these affect the visibility of women, reinforce harmful gender stereotypes, and limit the validity of the insights that can be gathered from such data.
50
Advances in Neural Information Processing Systems 28
Peter Flach, Meelis Kull · 2015 · 14.7K citations
Candace West, Don H. Zimmerman · Gender & Society · 1987 · 8.6K citations
Choice Reviews Online · 2004 · 4.7K citations