Scientific Reports · 2020 · 1.4K citations · 23 references
ComputingBiomedical InformaticsHealth InformaticsClinical InformaticsHealth Data ScienceMachine LearningData InteroperabilityData SharingFederated LearningFederated Learning PrivacyData DistributionData Distribution AnalysisData Distribution StrategiesDisease Prognostic BiomarkersModel AggregationMulti-institutional CollaborationPrognostic Biomarkers
Deep learning can uncover complex patterns for biomarkers, but large, diverse datasets are scarce and sharing patient data raises privacy and ownership concerns, making multi‑institutional collaboration difficult. Federated learning trains models across institutions by distributing updates and aggregating them locally, enabling data‑private collaboration without sharing raw data and outperforming other collaborative methods. Across ten institutions, federated models achieved 99 % of centralized performance, generalized well to external sites, and outperformed alternative collaborative approaches, showing that broader data access outweighs the minor errors introduced by the method.
Several studies underscore the potential of deep learning in identifying complex patterns, leading to diagnostic and prognostic biomarkers. Identifying sufficiently large and diverse datasets, required for training, is a significant challenge in medicine and can rarely be found in individual institutions. Multi-institutional collaborations based on centrally-shared patient data face privacy and ownership challenges. Federated learning is a novel paradigm for data-private multi-institutional collaborations, where model-learning leverages all available data without sharing data between institutions, by distributing the model-training to the data-owners and aggregating their results. We show that federated learning among 10 institutions results in models reaching 99% of the model quality achieved with centralized data, and evaluate generalizability on data from institutions outside the federation. We further investigate the effects of data distribution across collaborating institutions on model quality and learning patterns, indicating that increased access to data through data private multi-institutional collaborations can benefit model quality more than the errors introduced by the collaborative method. Finally, we compare with other collaborative-learning approaches demonstrating the superiority of federated learning, and discuss practical implementation considerations. Clinical adoption of federated learning is expected to lead to models trained on datasets of unprecedented size, hence have a catalytic impact towards precision/personalized medicine.
23
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Measures of the Amount of Ecologic Association Between Species
Lee R. Dice · Ecology · 1945 · 11.9K citations
The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository
Kenneth Clark, Bruce A. Vendt, Kirk Smith et al. · Journal of Digital Imaging · 2013 · 4.6K citations · Full text
Federated Learning with Non-IID Data
Yue Zhao, Meng Li, Liangzhen Lai et al. · arXiv (Cornell University) · 2018 · 1.9K citations · Full text