2018 · 17 citations · 22 references
ComputingAutonomous SystemsRobotics EngineeringMarkov Decision ProcessesMotion PlanningRoboticsAction RepresentationPartially Observable Markov Decision ProcessesReinforcement LearningRobot Motion PlanningTrajectory GenerationContinuous-state PomdpsMotion Planning Under UncertaintyPomdp SolversReproducing Kernel Hilbert SpacesSamplingSampling In State SpaceTrajectory PlanningTree Search
Decision making under uncertainty is a challenging task, especially when dealing with complex robotics scenarios. The Partially Observable Markov Decision Process (POMDP) framework, designed to solve this problem, was subject to much work lately. Most POMDP solvers, however, focus on planning in discrete state, action and/or observations spaces, which does not truly reflect the complexity of most real world problems. This paper addresses the issue by devising a method for solving POMDPs with continuous state, action and observations spaces. The proposed planner, Continuous Belief Tree Search (CBTS), uses Bayesian Optimisation (BO) to dynamically sample promising actions while constructing a belief tree. This dynamic sampling allows for richer action selection than offline action discretisation. CBTS is complemented by a novel trajectory generation technique, relying on the theory of Reproducing Kernel Hilbert Spaces (RKHS), yielding trajectories amenable for robotics applications. The resulting trajectory planner kCBTS outperforms other continuous planners on space modelling and robot parking problems.
22
Rapidly-exploring random trees : a new tool for path planning
Steven M. LaValle · 1998 · 3.6K citations
Monte-Carlo Planning in Large POMDPs
David Silver, Joel Veness · DSpace@MIT (Massachusetts Institute of Technology) · 2010 · 856 citations · Full text