2023 · 131 citations · 46 references
Social SciencesSocial PsychologyDisabilityDiscriminationStereotypingDisability DataDisability DiscriminationDisability IdentityDisability PrejudiceSocial Model Of DisabilityStigmatizationAnnotation DesignDialog SystemsDisability CommunityDisability LanguageDisability ResourceDisability Stereotyping In MediaLanguage Bias Toward DisabilityMedia Representation Of Disability
Large language models (LLMs) trained on real-world data can inadvertently reflect harmful societal biases, particularly toward historically marginalized communities. While previous work has primarily focused on harms related to age and race, emerging research has shown that biases toward disabled communities exist. This study extends prior work exploring the existence of harms by identifying categories of LLM-perpetuated harms toward the disability community. We conducted 19 focus groups, during which 56 participants with disabilities probed a dialog model about disability and discussed and annotated its responses. Participants rarely characterized model outputs as blatantly offensive or toxic. Instead, participants used nuanced language to detail how the dialog model mirrored subtle yet harmful stereotypes they encountered in their lives and dominant media, e.g., inspiration porn and able-bodied saviors. Participants often implicated training data as a cause for these stereotypes and recommended training the model on diverse identities from disability-positive resources. Our discussion further explores representative data strategies to mitigate harm related to different communities through annotation co-design with ML researchers and developers.
46
Advances in neural information processing systems 7
Computers & Mathematics with Applications · 1996 · 14.4K citations
On the Dangers of Stochastic Parrots
Emily M. Bender, Timnit Gebru, Angelina McMillan-Major et al. · 2021 · 5.6K citations · Full text
Computing, Computer Science, English +12
Measuring and Mitigating Unintended Bias in Text Classification
Lucas Dixon, John Li, Jeffrey Sorensen et al. · 2018 · 678 citations · Full text