2021 · 201 citations · 39 references
ComputingComputer ScienceComputer SystemsDistributed SystemsEdge ComputingMachine LearningEdge ArchitectureEdge Artificial IntelligenceEdge Computing InfrastructureEdge Resource ManagementFederated LearningAggregationAsynchronous ProcessingBandwidthClusteringEdge Computing NetworksEdge NodesPrivacyResource Allocation In Federated Learning
Federated learning (FL) has emerged in edge computing to address limited bandwidth and privacy concerns of traditional cloud-based centralized training. However, the existing FL mechanisms may lead to long training time and consume a tremendous amount of communication resources. In this paper, we propose an efficient FL mechanism, which divides the edge nodes into K clusters by balanced clustering. The edge nodes in one cluster forward their local updates to cluster header for aggregation by synchronous method, called cluster aggregation, while all cluster headers perform the asynchronous method for global aggregation. This processing procedure is called hierarchical aggregation. Our analysis shows that the convergence bound depends on the number of clusters and the training epochs. We formally define the resource-efficient federated learning with hierarchical aggregation (RFL-HA) problem. We propose an efficient algorithm to determine the optimal cluster structure (i.e., the optimal value of K) with resource constraints and extend it to deal with the dynamic network conditions. Extensive simulation results obtained from our study for different models and datasets show that the proposed algorithms can reduce completion time by 34.8%-70% and the communication resource by 33.8%-56.5% while achieving a similar accuracy, compared with the well-known FL mechanisms.
39
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio et al. · Proceedings of the IEEE · 1998 · 58.2K citations · Full text
TensorFlow: A system for large-scale machine learning
Martı́n Abadi, Paul Barham, Jianmin Chen et al. · arXiv (Cornell University) · 2016 · 8.8K citations · Full text
Edge Computing: Vision and Challenges
Weisong Shi, Jie Cao, Quan Zhang et al. · IEEE Internet of Things Journal · 2016 · 7.9K citations
TensorFlow: a system for large-scale machine learning
Martı́n Abadi, Paul Barham, Jianmin Chen et al. · Operating Systems Design and Implementation · 2016 · 6.4K citations
Qiang Yang, Yang Liu, Tianjian Chen et al. · ACM Transactions on Intelligent Systems and Technology · 2019 · 5.9K citations