Gender bias in artificial intelligence

Susan Leavy

2018 · 276 citations · 18 references

Concepts

TL;DR

Artificial intelligence increasingly shapes daily life, yet its male‑dominated design risks eroding gender‑equality gains, and although critical theory has long guided human decisions, AI learns from data that often embeds gender stereotypes, a gap that recent bias‑removal studies largely overlook. The study aims to integrate insights from gender‑ideology research into text‑based machine learning to curb the generation of biased algorithms. The authors argue that while large‑scale data processing can help, algorithms trained on gender‑stereotyped data will perpetuate bias, highlighting the need for bias‑aware training. The authors find that existing bias‑removal efforts neglect gender‑ideology research, that female leaders dominate the emerging bias‑AI field, and that gender balance in machine learning is essential to prevent algorithms from reinforcing disadvantageous gender ideologies.

Abstract

Artificial intelligence is increasingly influencing the opinions and behavior of people in everyday life. However, the over-representation of men in the design of these technologies could quietly undo decades of advances in gender equality. Over centuries, humans developed critical theory to inform decisions and avoid basing them solely on personal experience. However, machine intelligence learns primarily from observing data that it is presented with. While a machine's ability to process large volumes of data may address this in part, if that data is laden with stereotypical concepts of gender, the resulting application of the technology will perpetuate this bias. While some recent studies sought to remove bias from learned algorithms they largely ignore decades of research on how gender ideology is embedded in language. Awareness of this research and incorporating it into approaches to machine learning from text would help prevent the generation of biased algorithms. Leading thinkers in the emerging field addressing bias in artificial intelligence are also primarily female, suggesting that those who are potentially affected by bias are more likely to see, understand and attempt to resolve it. Gender balance in machine learning is therefore crucial to prevent algorithms from perpetuating gender ideologies that disadvantage women.

References

18