IEEE Transactions on Communications · 2010 · 50 citations · 19 references
EngineeringComputer ScienceElectrical EngineeringGame TheoryStochastic ProcessesWireless CommunicationsCognitive RadioMarkov ChainsMarkov ProcessesSpectrum ManagementStochastic GamesWireless Channel ModelingCognitive Radio NetworksFinite Markov ChainsFinite-state Markov ChainsRadio Resource AllocationSecondary User AccessStochastic ApproximationTime Division Multiple AccessTransmission Delay
This paper considers an uplink time division multiple access (TDMA) cognitive radio network where multiple cognitive radios (secondary users) attempt to access a spectrum hole. We assume that each secondary user can access the channel according to a decentralized predefined access rule based on the channel quality and the transmission delay of each secondary user. By modeling secondary user block fading channel qualities as a finite state Markov chain, we formulate the transmission rate adaptation problem of each secondary user as a general-sum Markovian dynamic game with a delay constraint. Conditions are given so that the Nash equilibrium transmission policy of each secondary user is a randomized mixture of pure threshold policies. Such threshold policies can be easily implemented. We then present a stochastic approximation algorithm that can adaptively estimate the Nash equilibrium policies and track such policies for non-stationary problems where the statistics of the channel and user parameters evolve with time.
19