2020 · 14 citations · 29 references
EngineeringComputer ScienceRobotics EngineeringHuman-robot InteractionRobot LearningRoboticsDexterous ManipulationIn-hand ManipulationManipulation LearningTactile LearningTactile PerceptionTactile SensingConvolutional Neural NetworksLong Short-term Memory NetworksTactile FeedbackTactile Force SensorsTactile In-hand ManipulationTactile Representation LearningTactile Sensing For ManipulationTactile Sensors
Performing various in-hand manipulation tasks, without learning each individual task, would enable robots to act more versatile, while reducing the effort for training. However, in general it is difficult to achieve stable in-hand manipulation, because the contact state between the fingertips becomes difficult to model, especially for a robot hand with anthropomorphically shaped fingertips. Rich tactile feedback can aid the robust task execution, but on the other hand it is challenging to process high-dimensional tactile information. In the current paper we use two fingers of the Allegro hand, and each fingertip is anthropomorphically shaped and equipped not only with 6-axis force-torque (F/T) sensors, but also with uSkin tactile sensors, which provide 24 tri-axial measurements per fingertip. A convolutional neural network is used to process the high dimensional uSkin information, and a long short-term memory (LSTM) handles the time-series information. The network is trained to generate two different motions ("twist" and "push"). The desired motion is provided as a task-parameter to the network, with twist defined as -1 and push as +1. When values between -1 and +1 are used as the task parameter, the network is able to generate untrained motions in-between the two trained motions. Thereby, we can achieve multiple untrained manipulations, and can achieve robustness with high-dimensional tactile feedback.
29
Learning dexterous in-hand manipulation
OpenAI Marcin Andrychowicz, Bowen Baker, Maciek Chociej et al. · The International Journal of Robotics Research · 2019 · 1.6K citations · Full text
Extrinsic dexterity: In-hand manipulation with external forces
Nikhil Chavan-Dafle, Alberto Rodríguez, Robert Paolini et al. · 2014 · 281 citations · Full text
Engineering, Mechatronics Engineering, Robotics Engineering +16
Tito Pradhono Tomo, Alexander Schmitz, Wai Keat Wong et al. · IEEE Robotics and Automation Letters · 2017 · 167 citations · Full text
Engineering, Mechanical Engineering, Robotics Engineering +17