IEEE Journal on Selected Areas in Communications · 2012 · 147 citations · 22 references
Social SciencesMathematicsDynamical SystemsGame TheoryMobile ComputingDynamic GamesMobile NetworksNash EquilibriumNetwork GamesReinforcement LearningStochastic GamesDifferential GamesLearning In Dynamic GamesReinforcement Learning ModelsRobust Dynamic GamesSwitching DelayUncertain Systems ModelingWireless Local Area NetworksWireless Personal Area Networks
In this paper, we study game dynamics and learning schemes for heterogeneous 4G networks. We introduce a novel learning scheme called cost-to-learn that incorporates the cost to switch, the switching delay, and the cost of changing to a new action and, captures the realistic behavior of the users that we have experimented on OPNET simulations. Considering a dynamic and uncertain environment where the users and operators have only a numerical value of their own payoffs as information, we construct various heterogeneous combined fully distributed payoff and strategy reinforcement learning (CODIPAS-RL): the users try to learn their own optimal payoff and their optimal strategy simultaneously. We establish the asymptotic pseudo-trajectories as solution of differential equations. Using evolutionary game dynamics, we prove the convergence and stability properties in specific classes of dynamic robust games. We provide various numerical examples and OPNET simulations in the context network selection in wireless local area networks (WLAN) and Long Term Evolution (LTE).
22
A Stochastic Approximation Method
Herbert Robbins, Sutton Monro · The Annals of Mathematical Statistics · 1951 · 9.6K citations · Full text
Evolutionary stable strategies and game dynamics
Peter Taylor, Leo Jonker · Mathematical Biosciences · 1978 · 3.5K citations
Social Sciences, Evolutionary Biology, Dynamical Systems +13
A Simple Adaptive Procedure Leading to Correlated Equilibrium
Sergiu Hart, Andreu Mas‐Colell · Econometrica · 2000 · 1.1K citations · Full text
Fastest Mixing Markov Chain on a Graph
Stephen Boyd, Persi Diaconis, Lin Xiao · SIAM Review · 2004 · 761 citations