2009 · 19 citations · 8 references
BusinessAutonomous SystemsArtificial IntelligenceMachine LearningMarkov Decision ProcessesAutonomous ExplorationExploration-exploitation TradeoffOptimal ControlPartially Observable Markov Decision ProcessesReinforcement LearningReinforcement Learning FoundationsExplorationExploration - Exploitation Trade-offExploration In Reinforcement LearningExploration-exploitation Trade-offLearning From ExplorationPartially Observable Reinforcement LearningReinforcement Learning Theory
A fundamental objective in reinforcement learning is the maintenance of a proper balance between exploration and exploitation. This problem becomes more chal-lenging when the agent can only partially observe the states of its environment. In this paper we propose a dual-policy method for jointly learning the agent be-havior and the balance between exploration exploitation, in partially observable environments. The method subsumes traditional exploration, in which the agent takes actions to gather information about the environment, and active learning, in which the agent queries an oracle for optimal actions (with an associated cost for employing the oracle). The form of the employed exploration is dictated by the specific problem. Theoretical guarantees are provided concerning the optimality of the balancing of exploration and exploitation. The effectiveness of the method is demonstrated by experimental results on benchmark problems. 1
8
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Applied Physics Letters · 2000 · 528 citations · Full text
Efficient reinforcement learning in factored MDPs
Michael Kearns, Daphne Koller · 1999 · 151 citations