IEEE Transactions on Network Science and Engineering · 2024 · 27 citations · 32 references
ComputingComputer ScienceIndustrial EngineeringArtificial IntelligenceInternet Of ThingsMachine LearningDeep LearningDigital Twin DesignEdge Artificial IntelligenceFederated LearningIndustrial Internet Of ThingsOptimization For Machine LearningAdaptive Federated LearningDeep Reinforcement LearningDigital Twin ArchitectureEdge IntelligenceIndustrial Internet Of Things IntegrationIndustrial Wireless NetworksReal-time ProcessingResource-constrained Computing
Digital twin (DT) can bridge the physical status with the virtual space in real-time for the Industrial Internet of Things (IIoT), where the integration of federated learning (FL) with DT can enable many edge intelligence services for timely intelligent production in the era of Industry 4.0. However, the issues of heterogeneity of devices and the resource-constrained IIoT make it challenging to achieve efficient FL via DT technology. To handle this problem, we propose a DT-enabled IIoT (DTENI) framework in wireless networks, in which DTs capture the characteristics of industrial devices to enable real-time processing and intelligent decision-making. Specifically, we first analyze the necessity of adaptive wireless parameters (i.e., CPU frequency, bandwidth, and transmission power) on FL training performance and provide theoretical analysis in the DTENI IIoT. Based on the above analysis, we then formulate the minimization problem of FL model loss under a given resource budget, which is a stochastic optimization problem with strongly coupled wireless parameters variables. Benefiting from the model-free learning superiority of deep reinforcement learning (DRL) in dealing with stochastic optimization problems, we develop DTENI-assisted DRL to adaptively adjust the wireless parameters for solving this optimization problem. Lastly, simulation results demonstrate that our proposed scheme can mostly save communication costs up to 74.23%, 69.51%, and 60.94% compared to the three benchmarks.
32
Deep Reinforcement Learning with Double Q-Learning
Hado van Hasselt, Arthur Guez, David Silver · 2016 · 6K citations · Full text
Federated Learning: Strategies for Improving Communication Efficiency
Jakub Konečný, H. Brendan McMahan, Felix X. Yu et al. · arXiv (Cornell University) · 2016 · 3K citations · Full text
Optimizing Federated Learning on Non-IID Data with Reinforcement Learning
Hao Wang, Zakhary Kaplan, Di Niu et al. · 2020 · 958 citations