IEEE Robotics and Automation Letters · 2023 · 34 citations · 17 references
EngineeringComputer ScienceRobotics EngineeringRobot ControlRobot LearningRoboticsDexterous ManipulationPolicy LearningReinforcement LearningRobot ManipulationSim-to-real TransferTactile SensingDeep Reinforcement LearningHigh-resolution Tactile SensingLearned Reward FunctionsReinforcement Learning For ManipulationReinforcement Learning For RoboticsTactile FeedbackTactile ManipulationTactile Sensors
Bimanual manipulation with tactile feedback will be key to human-level robot dexterity. However, this topic is less explored than single-arm settings, partly due to the availability of suitable hardware along with the complexity of designing effective controllers for tasks with relatively large state-action spaces. Here we introduce a dual-arm tactile robotic system (Bi-Touch) based on the Tactile Gym 2.0 setup that integrates two affordable industrial-level robot arms with low-cost high-resolution tactile sensors (TacTips). We present a suite of bimanual manipulation tasks tailored towards tactile feedback: bi-pushing, bi-reorienting, and bi-gathering. To learn effective policies, we introduce appropriate reward functions for these tasks and propose a novel goal-update mechanism with deep reinforcement learning. We also apply these policies to real-world settings with a tactile sim-to-real approach. Our analysis highlights and addresses some challenges met during the sim-to-real application, e.g. the learned policy tended to squeeze an object in the bi-reorienting task due to the sim-to-real gap. Finally, we demonstrate the generalizability and robustness of this system by experimenting with different unseen objects with applied perturbations in the real world.
17
Learning dexterous in-hand manipulation
OpenAI Marcin Andrychowicz, Bowen Baker, Maciek Chociej et al. · The International Journal of Robotics Research · 2019 · 1.6K citations · Full text
Dual arm manipulation—A survey
Christian Smith, Yiannis Karayiannidis, Lazaros Nalpantidis et al. · Robotics and Autonomous Systems · 2012 · 549 citations · Full text
Engineering, Mechatronics Engineering, Robotics Engineering +14