2022 · 18 citations · 10 references
ComputingComputer ScienceComputer SystemsDecentralizationDistributed SystemsMachine LearningDecentralized ControlDistributed AlgorithmsDistributed ComputingDistributed LearningFederated LearningReliable Distributed SystemsBlockchain ApplicationsDecentralized Federated LearningDescent OptimizationFederated Training ArchitectureGradient DescentModel SynchronizationModel Synchronization PatternsSynchronization
The rapid expansion of data worldwide invites the need for more distributed solutions in order to apply machine learning on a much wider scale. The resultant distributed learning systems can have various degrees of centralization. In this work, we demonstrate our solution FLoBC for building a generic decentralized federated learning system using the blockchain technology, accommodating any machine learning model that is compatible with gradient descent optimization. We present our system design comprising the two decentralized actors: trainer and validator, alongside our methodology for ensuring reliable and efficient operation of said system. Finally, we utilize FLoBC as an experimental sandbox to compare and contrast the effects of trainer-to-validator ratio, reward-penalty policy, and model synchronization schemes on the overall system performance, ultimately showing by example that a decentralized federated learning system is indeed a feasible alternative to more centralized architectures.
10
Blockchained On-Device Federated Learning
Hyesung Kim, Jihong Park, Mehdi Bennis et al. · IEEE Communications Letters · 2019 · 871 citations · Full text
A Blockchain-Based Decentralized Federated Learning Framework with Committee Consensus
Yuzheng Li, Chuan Chen, Nan Liu et al. · IEEE Network · 2020 · 627 citations · Full text
Peer-to-peer Federated Learning on Graphs
Anusha Lalitha, Osman Cihan Kilinc, Tara Javidi et al. · arXiv (Cornell University) · 2019 · 140 citations · Full text