IEEE Journal on Selected Areas in Communications · 2019 · 27 citations · 26 references
EngineeringComputer ScienceElectrical EngineeringMachine LearningMarkov Decision ProcessesWireless CommunicationsCognitive RadioPartially Observable Markov Decision ProcessesRadar SystemsReinforcement LearningSpectrum ManagementWireless NetworksCognitive Interference MitigationCognitive Radio NetworksDynamic Spectrum AccessNetwork Throughput AnalysisNetwork Throughput OptimizationOpportunistic Spectrum AccessSpectrum SharingThroughput
In order to beneficially exploit the scarce wireless spectral resources, spectrum sharing between communication and radar systems has become a promising research topic. However, traditional network association strategies may not result in efficient hybrid communication and radar systems. We circumvent this problem by formulating a partially observable Markov decision processes (POMDP) aided network association scheme, where the radar user acts as the primary user (PU), while the cognitive communication user is the secondary user (SU). For maximizing the network throughput, whilst minimizing the interference imposed on the radar user, the communication user is configured for adaptively selecting its underlay or overlay access mode. Moreover, a low-complexity near-optimal reinforcement learning algorithm is proposed for the co-design by considering both its complexity and feasibility. Finally, we quantify the performance of our proposed POMDP based network association scheme.
26
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
A Survey of Dynamic Spectrum Access
Qing Zhao, Brian M. Sadler · IEEE Signal Processing Magazine · 2007 · 2.7K citations
Richard Bellman · Quarterly of Applied Mathematics · 1958 · 2.7K citations · Full text