Proceedings of the 44th International Conference on Software Engineering · 2022 · 45 citations · 16 references
ComputingComputer ScienceData ScienceArtificial IntelligenceFeature EngineeringMachine LearningAlgorithmic FairnessEvolutionary ComputationExplainable Machine LearningFairness In Machine LearningOptimization For Machine LearningEfficiencyExplainable FairnessFairnessGenetic Algorithm OptimizationIndividual FairnessTrusted Systems
The fairness characteristic is a critical attribute of trusted AI systems. A plethora of research has proposed diverse methods for individual fairness testing. However, they are suffering from three major limitations, i.e., low efficiency, low effectiveness, and model-specificity. This work proposes ExpGA, an explanation-guided fairness testing approach through a genetic algorithm (GA). ExpGA employs the explanation results generated by interpretable methods to collect high-quality initial seeds, which are prone to derive discriminatory samples by slightly modifying feature values. ExpGA then adopts GA to search discriminatory sample candidates by optimizing a fitness value. Benefiting from this combination of explanation results and GA, ExpGA is both efficient and effective to detect discriminatory individuals. Moreover, ExpGA only requires prediction probabilities of the tested model, resulting in a better generalization capability to various models. Experiments on multiple real-world benchmarks, including tabular and text datasets, show that ExpGA presents higher efficiency and effectiveness than four state-of-the-art approaches.
16
Marco Túlio Ribeiro, Sameer Singh, Carlos Guestrin · 2016 · 15.2K citations
Fairness testing: testing software for discrimination
Sainyam Galhotra, Yuriy Brun, Alexandra Meliou · 2017 · 398 citations · Full text