2003 · 175 citations · 11 references
ComputingComputer ScienceArtificial IntelligenceGame TheoryMachine LearningAdaptive BehaviorAdaptive LearningExploration-exploitation TradeoffPolicy LearningReinforcement LearningReinforcement Learning FoundationsGame-theoretic LearningLearning In GamesMulti-agent Reinforcement LearningOptimal PoliciesQ-learningReinforcement Learning In GamesReinforcement Learning ModelsReinforcement Learning Theory
Recent multi-agent extensions of Q-Learning require knowledge of other agents' payoffs and Q-functions, and assume game-theoretic play at all times by all other agents. This paper proposes a fundamentally different approach, dubbed "Hyper-Q" Learning, in which values of mixed strategies rather than base actions are learned, and in which other agents' strategies are estimated from observed actions via Bayesian inference. Hyper-Q
11