2021 · 21 citations · 17 references
ComputingComputer ScienceComputer SystemsDistributed SystemsEnergy ManagementMachine LearningEnergy-efficient Cloud ComputingFederated LearningPower ManagementCommunication Overhead ReductionEnergy ControlEnergy-efficient Resource ManagementEnergy-optimal ControlHierarchical Federated LearningLyapunov FunctionsPolynomial-time AlgorithmsResource Allocation In Federated Learning
Federated learning (FL) has become a promising solution to train a shared model without exchanging local training samples. However, in the traditional cloud-based FL framework, clients suffer from limited energy budget and generate excessive communication overhead on the backbone network. These drawbacks motivate us to propose an energy-aware hierarchical federated learning framework in which the edge servers assist the cloud server to migrate the local models from the clients. Then a joint local computing power control and client association problem is formulated in order to minimize the training loss and the training latency simultaneously under the long-term energy constraints. To solve the problem, we recast it based on the general Lyapunov optimization framework with the instantaneous energy budget. We then propose a heuristic algorithm, which takes the importance of local updates into account, to achieve a suboptimal solution in polynomial time. Numerical results demonstrate that the proposed algorithm can reduce the training latency compared to the scheme with greedy client association and myopic energy control, and improve the learning performance compared to the scheme in which the associated clients transmit their local models with the maximal power.
17
Communication-Efficient Learning of Deep Networks from Decentralized Data
H. Brendan McMahan, Eider Moore, Daniel Ramage et al. · arXiv (Cornell University) · 2016 · 5.2K citations · Full text
On the Convergence of FedAvg on Non-IID Data
Xiang Li, Kaixuan Huang, Wenhao Yang et al. · arXiv (Cornell University) · 2019 · 1K citations · Full text
Client-Edge-Cloud Hierarchical Federated Learning
Lumin Liu, Jun Zhang, Shenghui Song et al. · 2020 · 886 citations