EURASIP Journal on Advances in Signal Processing · 2009 · 100 citations · 30 references
EngineeringAutonomous SystemsRobotics EngineeringAerial RoboticsMarkov Decision ProcessesUnmanned Aircraft SystemsOptimal ControlPartially Observable Markov Decision ProcessesTrajectory OptimizationConstraintsGuidanceGuidance SystemsMean Squared ErrorMean Squared Error AnalysisMotion Planning Under Dynamic ConstraintsMultitarget TrackingPomdp Solvers
This paper discusses the application of the theory of partially observable Markov decision processes (POMDPs) to the design of guidance algorithms for controlling the motion of unmanned aerial vehicles (UAVs) with onboard sensors to improve tracking of multiple ground targets. While POMDP problems are intractable to solve exactly, principled approximation methods can be devised based on the theory that characterizes optimal solutions. A new approximation method called nominal belief-state optimization (NBO), combined with other application-specific approximations and techniques within the POMDP framework, produces a practical design that coordinates the UAVs to achieve good long-term mean-squared-error tracking performance in the presence of occlusions and dynamic constraints. The flexibility of the design is demonstrated by extending the objective to reduce the probability of a track swap in ambiguous situations.
30
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Sebastian Thrun · Communications of the ACM · 2002 · 8K citations
<i>Tracking and Data Association</i>
Yaakov Bar‐Shalom, Thomas Fortmann, Peter G. Cable · The Journal of the Acoustical Society of America · 1990 · 3.1K citations · Full text
Computing, Mathematics, Physics +14
Online Planning Algorithms for POMDPs
Stéphane Ross, Joëlle Pineau, S. Paquet et al. · Journal of Artificial Intelligence Research · 2008 · 515 citations · Full text
Cooperative air and ground surveillance
Ben Grocholsky, James F. Keller, Vijay Kumar et al. · IEEE Robotics & Automation Magazine · 2006 · 496 citations