IEEE Robotics and Automation Letters · 2018 · 198 citations · 24 references
EngineeringAutonomous SystemsComputer ScienceArtificial IntelligenceMachine LearningRoboticsAutonomous NavigationImitation LearningLearning From DemonstrationPolicy LearningReinforcement LearningRobot NavigationDeep Reinforcement LearningDeep Reinforcement Learning For NavigationMapless NavigationReinforcement Learning For NavigationSample ComplexitySample-efficient Policy LearningSample-efficient Reinforcement LearningSample-efficient Robot Learning
This letter presents a case study of a learning-based approach for target-driven mapless navigation. The underlying navigation model is an end-to-end neural network, which is trained using a combination of expert demonstrations, imitation learning (IL) and reinforcement learning (RL). While RL and IL suffer from a large sample complexity and the distribution mismatch problem, respectively, we show that leveraging prior expert demonstrations for pretraining can reduce the training time to reach at least the same level of the performance compared to plain RL by a factor of 5. We present a thorough evaluation of different combinations of expert demonstrations, different RL algorithms, and reward functions, both in simulation and on a real robotic platform. Our results show that the final model outperforms both standalone approaches in the amount of successful navigation tasks. In addition, the RL reward function can be significantly simplified when using pretraining, e.g., by using a sparse reward only. The learned navigation policy is able to generalize to unseen and real-world environments.
24
Trust Region Policy Optimization
John Schulman, Sergey Levine, Philipp Moritz et al. · arXiv (Cornell University) · 2015 · 3.1K citations · Full text
DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving
Chenyi Chen, Ari Seff, Alain L. Kornhauser et al. · 2015 · 1.8K citations
Target-driven visual navigation in indoor scenes using deep reinforcement learning
Yuke Zhu, Roozbeh Mottaghi, Eric Kolve et al. · 2017 · 1.5K citations