2018 · 93 citations · 49 references
ComputingComputer ScienceAssessment FairnessDiscriminationSoftware EngineeringAlgorithmic FairnessDiscrimination TestingFairness In TestingSoftware MetricsSoftware TestingTest BiasAutomated Test GenerationBias DetectionBias In Computer-based TestingCausal RelationshipsDiscrimination DetectionDiscrimination In Automated Decision-makingOpen-source Software DevelopmentTest Suite Generation
Bias in decisions made by modern software is becoming a common and serious problem. We present Themis, an automated test suite generator to measure two types of discrimination, including causal relationships between sensitive inputs and program behavior. We explain how Themis can measure discrimination and aid its debugging, describe a set of optimizations Themis uses to reduce test suite size, and demonstrate Themis' effectiveness on open-source software. Themis is open-source and all our evaluation data are available at http://fairness.cs.umass.edu/. See a video of Themis in action: https://youtu.be/brB8wkaUesY
49
Cynthia Dwork, Moritz Hardt, Toniann Pitassi et al. · 2012 · 3.4K citations
Causal inference in statistics: An overview
Judea Pearl · Statistics Surveys · 2009 · 2.3K citations · Full text
Rich Zemel, Yu Wu, Kevin Swersky et al. · 2013 · 1K citations