2020 · 14 citations · 38 references
EngineeringComputer ScienceRobotics EngineeringGraspingRobot ControlRoboticsManipulation ControlManipulation LearningModel-based Robot LearningPolicy LearningRobot ManipulationUncertainty EstimationActive LocalizationContact-rich ManipulationDynamic ManipulationManipulationManipulation Under UncertaintyMotion ControllersPartial ObservabilityRobot Grasping
In this paper, we present an integrated, model-based system for state estimation and control in dynamic manipulation tasks with partial observability. We track a belief over the system state using a particle filter from which we extract a Gaussian Mixture Model (GMM). This compressed representation of the belief is used to automatically create a discrete set of goal-directed motion controllers. A reinforcement learning agent then switches between these motion controllers in real-time to accomplish the manipulation task. The proposed system closes the loop from joint sensor feedback to high-frequency, accelerationlimited position commands, thus eliminating the need for preand post-processing. We evaluate our approach with respect to five distinct manipulation tasks from the domains of active localization, grasping under uncertainty, assembly, and nonprehensile object manipulation. Extensive simulations demonstrate that the hierarchical policy actively exploits the uncertainty information encoded in the compressed belief. Finally, we validate the proposed method on a real-world robot.
38
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Deep Reinforcement Learning with Double Q-Learning
Hado van Hasselt, Arthur Guez, David Silver · 2016 · 6K citations · Full text
On the Theory of the Brownian Motion
G. E. Uhlenbeck, L. S. Ornstein · Physical Review · 1930 · 4.5K citations