arXiv (Cornell University) · 2017 · 92 citations · 24 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningRoboticsDeep LearningImitation LearningLearning From DemonstrationPolicy LearningReinforcement LearningReinforcement Learning FoundationsDeep Imitation LearningDeep Reinforcement LearningImitation From ObservationLearning By ImitationReinforcement Learning For RoboticsSample ComplexitySample Complexity AnalysisStochastic Gradient Descent
Researchers have demonstrated state-of-the-art performance in sequential\ndecision making problems (e.g., robotics control, sequential prediction) with\ndeep neural network models. One often has access to near-optimal oracles that\nachieve good performance on the task during training. We demonstrate that\nAggreVaTeD --- a policy gradient extension of the Imitation Learning (IL)\napproach of (Ross & Bagnell, 2014) --- can leverage such an oracle to achieve\nfaster and better solutions with less training data than a less-informed\nReinforcement Learning (RL) technique. Using both feedforward and recurrent\nneural network predictors, we present stochastic gradient procedures on a\nsequential prediction task, dependency-parsing from raw image data, as well as\non various high dimensional robotics control problems. We also provide a\ncomprehensive theoretical study of IL that demonstrates we can expect up to\nexponentially lower sample complexity for learning with AggreVaTeD than with RL\nalgorithms, which backs our empirical findings. Our results and theory indicate\nthat the proposed approach can achieve superior performance with respect to the\noracle when the demonstrator is sub-optimal.\n
24
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Mastering the game of Go with deep neural networks and tree search
David Silver, Aja Huang, Chris J. Maddison et al. · Nature · 2016 · 15.8K citations
Sequence to Sequence Learning with Neural Networks
Ilya Sutskever, Oriol Vinyals, Quoc V. Le · arXiv (Cornell University) · 2014 · 3.5K citations · Full text
Computing, Computer Science, French +14