Own your potential (DEAKIN) · 2000 · 12 citations · 16 references
ComputingComputer ScienceKnowledge RepresentationMachine LearningProbability TheoryBayesian InferenceBayesian StatisticsMarkov ProcessesPolicy LearningReinforcement LearningUncertainty RepresentationAbstractionAbstraction LevelsBayesian NetworksComplexityHierarchyPlan RecognitionPolicy RepresentationState Abstraction
\n\t\t\t\t\tAbstraction plays an essential role in the way the agents plan their behaviours, especially to reduce the computational complexity of planning in large domains. However, the effects of abstraction in the inverse process &ndash; plan recognition &ndash; are unclear. In this paper, we present a method for recognising the agent&rsquo;s behaviour in noisy and uncertain domains, and across multiple levels of abstraction. We use the concept of abstract Markov policies in abstract probabilistic planning as the model of the agent&rsquo;s behaviours and employ probabilistic inference in Dynamic Bayesian Networks (DBN) to infer the correct policy from a sequence of observations. When the states are fully observable, we show that for a broad and often-used class of abstract policies, the complexity of policy recognition scales well with the number of abstraction levels in the policy hierarchy. For the partially observable case, we derive an efficient hybrid inference scheme on the corresponding DBN to overcome the exponential complexity.<br />\n\t\t\t\t
16
A model for reasoning about persistence and causation
Thomas Dean, Keiji Kanazawa · Computational Intelligence · 1989 · 999 citations
Reinforcement Learning with Hierarchies of Machines
Ronald Parr, Stuart Russell · 1997 · 616 citations
Tractable Inference for Complex Stochastic Processes
Xavier Boyen, Daphne Koller · arXiv (Cornell University) · 2013 · 488 citations · Full text