IEEE Transactions on Communications · 2022 · 102 citations · 37 references
ManagementComputer EngineeringEnergy ManagementOptimizationSchedulingEnergy EfficiencyExploration-exploitation TradeoffInterference ManagementPower ManagementReinforcement LearningResource-constrained SchedulingCognitive Radio NetworksDeep Reinforcement LearningEnergy Optimization AlgorithmsPerformance-energy Trade-off OptimizationRadio Resource ManagementSpectrum EfficiencyThroughput ModelingTime-triggered Scheduling
Ambient backscatter (AB) communications and radio frequency (RF)-powered cognitive radio networks (CRNs) address the concerns of energy and spectrum scarcities from different perspectives, and the integration of them has potential benefits for throughput. Motivated by this fact, we study the RF-powered AB-assisted hybrid underlay CRN (ABHU-CRN), and optimize the long-term secondary throughput. Based on the channel states, secondary users choose to perform different actions, and two action spaces are accordingly designed. Due to dynamic and unpredictable environment states, we jointly control the time scheduling and energy management of secondary users, and propose two algorithms, i.e., adjusted-deep deterministic policy gradient (A-DDPG) and combination of A-DDPG and convex optimization (C-ADCO), for the long-term secondary throughput. A-DDPG, a deep reinforcement learning algorithm with continuous spaces, is extended from DDPG to adapt to the design of two action spaces. C-ADCO utilizes the convex optimization that can find the optimal solution to assist A-DDPG to accelerate the convergence. In simulations, the ABHU-CRN under A-DDPG and C-ADCO achieves higher throughput than the optimal throughput of AB-assisted overlay CRN and AB-assisted underlay CRN, which indicates the advantage of the hybrid transmission mode in the ABHU-CRN.
37
Real-time status: How often should one update?
Sanjit K. Kaul, Roy D. Yates, Marco Gruteser · 2012 · 2.4K citations
Resource Management with Deep Reinforcement Learning
Hongzi Mao, Mohammad Alizadeh, Ishai Menache et al. · 2016 · 1.2K citations
Ambient Backscatter Communications: A Contemporary Survey
Nguyễn Văn Huynh, Dinh Thai Hoang, Xiao Lu et al. · IEEE Communications Surveys & Tutorials · 2018 · 921 citations