Sensors · 2021 · 15 citations · 29 references
EngineeringComputer ScienceRobotics EngineeringGraspingHuman-robot InteractionRoboticsDexterous ManipulationManipulation ControlManipulation LearningMulti-fingered GraspingObject ManipulationRobot ManipulationAnthropomorphic Robotic HandsDeep Reinforcement LearningGrasp Representation LearningNormalizing FlowsRobot GraspingWhole-hand Manipulation
Anthropomorphic robotic hands are designed to attain dexterous movements and flexibility much like human hands. Achieving human-like object manipulation remains a challenge especially due to the control complexity of the anthropomorphic robotic hand with a high degree of freedom. In this work, we propose a deep reinforcement learning (DRL) to train a policy using a synergy space for generating natural grasping and relocation of variously shaped objects using an anthropomorphic robotic hand. A synergy space is created using a continuous normalizing flow network with point clouds of haptic areas, representing natural hand poses obtained from human grasping demonstrations. The DRL policy accesses the synergistic representation and derives natural hand poses through a deep regressor for object grasping and relocation tasks. Our proposed synergy-based DRL achieves an average success rate of 88.38% for the object manipulation tasks, while the standard DRL without synergy space only achieves 50.66%. Qualitative results show the proposed synergy-based DRL policy produces human-like finger placements over the surface of each object including apple, banana, flashlight, camera, lightbulb, and hammer.
29
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Raffaelli Charles, Hao Su, Kaichun Mo et al. · 2017 · 9.8K citations
MuJoCo: A physics engine for model-based control
Emanuel Todorov, Tom Erez, Yuval Tassa · 2012 · 4.4K citations
Engineering, Mechanical Engineering, Robotics Engineering +17
Learning dexterous in-hand manipulation
OpenAI Marcin Andrychowicz, Bowen Baker, Maciek Chociej et al. · The International Journal of Robotics Research · 2019 · 1.6K citations · Full text
Postural Hand Synergies for Tool Use
Marco Santello, Martha Flanders, John F. Soechting · Journal of Neuroscience · 1998 · 1.2K citations · Full text