Belief Mdps

Belief MDPs is a Markov decision process in which the state space consists of beliefs—probability distributions over the underlying POMDP's hidden states—thereby transforming a partially observable problem into a fully observable one over beliefs, with transitions and rewards defined by the original POMDP's dynamics.

Publications

584

Citations

Authors

Institutions

Publications per year

2017–2026

Variants

Belief Markov Decision ProcessesBelief-mdps

Parents

Partially Observable Markov Decision Processes

Publications

An improved grid-based approximation algorithm for POMDPs

Rong Zhou, Eric A. Hansen · 2001 · 99 citations

Business, Decision Sciences, Algorithms +12

Graphical models for interactive POMDPs: representations and solutions

Prashant Doshi, Yifeng Zeng, Qiongyu Chen · Autonomous Agents and Multi-Agent Systems · 2008 · 93 citations

Computing, Autonomous Systems, Knowledge Representation +13

Forward search value iteration for POMDPs

Guy Shani, Ronen I. Brafman, Solomon Eyal Shimony · 2007 · 84 citations

Computing, Computer Science, Algorithms +13

A Hierarchical Approach to POMDP Planning and Execution

Joëlle Pineau, Nicholas Roy, Sebastian Thrun · 2004 · 73 citations

Business, Autonomous Systems, Markov Decision Processes +11

A Scalable Method for Solving High-Dimensional Continuous POMDPs Using Local Approximation

Tom Erez · Open Scholarship Institutional Repository (Washington University in St. Louis) · 2010 · 42 citations · Full text

Computing, Autonomous Systems, Markov Decision Processes +14

1–5 of 14

Authors

GS
Guy Shani
Ben-Gurion University of the Negev, Israel
2 publications · 101 citations
2
h-index
PD
Prashant Doshi
University of Georgia, United States
2 publications · 127 citations
2
h-index
SE
Solomon Eyal Shimony
Ben-Gurion University of the Negev, Israel
2 publications · 101 citations
2
h-index
RI
Ronen I. Brafman
Ben-Gurion University of the Negev, Israel
2 publications · 101 citations
2
h-index
TE
Tom Erez
University of Washington, United States
1 publications · 42 citations
1
h-index

1–5 of 32

Institutions

1–8 of 19

Venues

Autonomous Agents and Multi-Agent Systems
2 publications · 121 citations
2
h-index
IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics)
1 publications · 17 citations
1
h-index
Robotics and Autonomous Systems
1 publications · 11 citations
1
h-index
Open Scholarship Institutional Repository (Washington University in St. Louis)
Repository · 1 publications · 42 citations
1
h-index
Neural Processing Letters
1 publications · 10 citations

1–5