2022 · 22 citations · 14 references
ComputingComputer ScienceDecentralizationDistributed SystemsMachine LearningDeep LearningDistributed AlgorithmsDistributed ComputingDistributed Data ProcessingDistributed LearningFederated LearningDecentralized Federated LearningDistributed Machine LearningFederated Training ArchitectureHierarchical Federated LearningLocal Data ProcessingMean Absolute ErrorMean Squared ErrorModel Aggregation
Federated Learning (FL) is a recent approach for distributed Machine Learning (ML) where data are never communicated to a central node. Instead, an ML model (for example, a deep neural network) is initialized by a designated central (aggregation) node and shared with training nodes that have direct access to data of interest. These training nodes then perform small batches of training on their local data. Periodically, each training node submits ML model parameter/weight updates to the central node. The central node aggregates the parameters/weights to create a new global ML model that it then re-shares with the training nodes. This process can either take place indefinitely or be repeated until the ML model converges with respect to some evaluation metric (for example, mean average error, accuracy).
14
Wei Yang Bryan Lim, Jer Shyuan Ng, Zehui Xiong et al. · IEEE Transactions on Parallel and Distributed Systems · 2021 · 290 citations · Full text
Mehryar Mohri, Gary Sivek, Ananda Theertha Suresh · arXiv (Cornell University) · 2019 · 259 citations · Full text
funcX: A Federated Function Serving Fabric for Science
Ryan Chard, Yadu Babuji, Zhuozhao Li et al. · 2020 · 191 citations · Full text