IEEE Communications Letters · 2022 · 19 citations · 13 references
ComputingComputer ScienceComputer SystemsAlgorithmsMachine LearningOptimizationFederated LearningFederated Learning PrivacyLatency OptimizationOptimization For Machine LearningResource-constrained SchedulingWireless Privacy ProtectionBandwidthNetwork LatencyPower AllocationQuantizationResource Allocation In Federated LearningUpper Bound ComputationUpper BoundsWireless Networking
Federated learning (FL) protects data privacy through local training and parameter aggregation. However, there is no need that all users are required to train their local models, and the parameter needs to be quantized via wireless channels in practice. In this letter, we investigate and analyze how to improve the model prediction accuracy with the system latency guarantee. Specifically, our goal is to minimize the loss function under the latency constraint by taking the parameter quantization, user scheduling, and channel bandwidth and transmit power into account. To make the optimization problem tractable, we first derive an upper bound on the loss function with joint quantization and scheduling and an upper bound on the number of bits for parameter aggregation, and then solve the reformulated problem based on the derived upper bounds to obtain closed-form expressions for the quantization level, the scheduling number, the optimized bandwidth and power allocation. Simulation results confirm the convergence and the effectiveness of the proposed algorithm.
13
QSGD: Communication-Efficient SGD via Gradient Quantization and Encoding
Dan Alistarh, Demjan Grubic, Jerry Li et al. · arXiv (Cornell University) · 2016 · 912 citations · Full text
Robust Federated Learning With Noisy Communication
Fan Ang, Li Chen, Nan Zhao et al. · IEEE Transactions on Communications · 2020 · 146 citations · Full text