2023 · 65 citations · 44 references
ComputingComputer ScienceBiomedical ImagingDiagnostic ImagingMachine LearningFairness In Machine LearningFederated LearningGradient-based OptimizationMedical Image AnalysisOptimization For Machine LearningRepresentation LearningError PredictionFairness In Federated LearningFederated OptimizationMedical Image SegmentationModel Aggregation
How to ensure fairness is an important topic in federated learning (FL). Recent studies have investigated how to reward clients based on their contribution (collaboration fairness), and how to achieve uniformity of performance across clients (performance fairness). Despite achieving progress on either one, we argue that it is critical to consider them together, in order to engage and motivate more diverse clients joining FL to derive a high-quality global model. In this work, we propose a novel method to optimize both types of fairness simultaneously. Specifically, we propose to estimate client contribution in gradient and data space. In gradient space, we monitor the gradient direction differences of each client with respect to others. And in data space, we measure the prediction error on client data using an auxiliary model. Based on this contribution estimation, we propose a FL method, federated training via contribution estimation (FedCE), i.e., using estimation as global model aggregation weights. We have theoretically analyzed our method and empirically evaluated it on two real-world medical datasets. The effectiveness of our approach has been validated with significant performance improvements, better collaboration fairness, better performance fairness, and comprehensive analytical studies. Code is available at https://nvidia.github.io/NVFlare/research/fed-ce
44
The future of digital health with federated learning
npj Digital Medicine · 2020 · 2.5K citations · Full text
Federated Learning for Healthcare Informatics
Jie Xu, Benjamin S. Glicksberg, Chang Su et al. · Journal of Healthcare Informatics Research · 2020 · 1.4K citations · Full text
On the Convergence of FedAvg on Non-IID Data
Xiang Li, Kaixuan Huang, Wenhao Yang et al. · arXiv (Cornell University) · 2019 · 1K citations · Full text