2018 · 12 citations · 16 references
ComputingAutonomous SystemsComputer ScienceMotion PlanningRobot ControlRoboticsAutonomous NavigationNavigation PlanningReinforcement LearningRobot Motion PlanningRobot NavigationTrajectory PredictionCombinatorial SearchGraph Representation LearningInverse Reinforcement LearningLearned Reward FunctionsPredictive PursuitPursuitReinforcement Learning For NavigationReinforcement Learning For Robotics
We address the integrated prediction, planning, and control problem that enables a single follower robot (the photographer) to quickly re-establish visual contact with a moving target (the subject) that has escaped the follower's field of view. We deal with this scenario, which reactive controllers are typically ill-equipped to handle, by making plausible predictions about the long- and short-term behavior of the target, and planning pursuit paths that will maximize the chance of seeing the target again. At the core of our pursuit method is the use of predictive models of target behavior, which help narrow down the set of possible future locations of the target to a few discrete hypotheses, as well as the use of combinatorial search in physical space to check those hypotheses efficiently. We model target behavior in terms of a learned navigation reward function, using Inverse Reinforcement Learning, based on semantic terrain features of satellite maps. Our pursuit algorithm continuously predicts the latent destination of the target and its position in the future, and relies on efficient graph representation and search methods in order to navigate to locations at which the target is most likely to be seen at an anticipated time. We perform extensive evaluation of our predictive pursuit algorithm over multiple satellite maps, thousands of simulation scenarios, against state-of-the art MDP and POMDP solvers. We show that our method significantly outperforms them by exploiting domain-specific knowledge, while being able to run in real-time.
16
Finding the <i>K</i> Shortest Loopless Paths in a Network
Jin Y. Yen · Management Science · 1971 · 2.6K citations
Monte-Carlo Planning in Large POMDPs
David Silver, Joel Veness · DSpace@MIT (Massachusetts Institute of Technology) · 2010 · 856 citations · Full text
Planning-based prediction for pedestrians
Brian D. Ziebart, Nathan Ratliff, Garratt Gallagher et al. · 2009 · 469 citations · Full text
A survey of point-based POMDP solvers
Guy Shani, Joëlle Pineau, Robert Kaplow · Autonomous Agents and Multi-Agent Systems · 2012 · 433 citations