IEEE Transactions on Robotics · 2024 · 18 citations · 37 references
EngineeringComputer ScienceRobotics EngineeringMachine LearningRobot LearningRoboticsDexterous ManipulationManipulation ControlManipulation LearningTactile PerceptionTactile SensingContact-rich InteractionContact-rich ManipulationManipulationPeg-in-hole AssemblyPeg-in-hole ControlReinforcement Learning For ManipulationTactile Feature ExtractionVisuotactile Learning
Visuotactile sensors can provide rich contact information, having great potential in contact-rich manipulation tasks with reinforcement learning (RL) policies. Sim2Real technique tackles the challenge of RL's reliance on a large amount of interaction data. However, most Sim2Real methods for manipulation tasks with visuotactile sensors rely on rigid-body physics simulation, which fails to simulate the real elastic deformation precisely. Moreover, these methods do not exploit the characteristic of tactile signals for designing the network architecture. In this paper, we build a general-purpose Sim2Real protocol for manipulation policy learning with marker-based visuotactile sensors. To improve the simulation fidelity, we employ an FEM-based physics simulator that can simulate the sensor deformation accurately and stably for arbitrary geometries. We further propose a novel tactile feature extraction network that directly processes the set of pixel coordinates of tactile sensor markers and a self-supervised pre-training strategy to improve the efficiency and generalizability of RL policies. We conduct extensive Sim2Real experiments on the peg-in-hole task to validate the effectiveness of our method. And we further show its generalizability on additional tasks including plug adjustment and lock opening. The protocol, including the simulator and the policy learning framework, will be open-sourced for community usage.
37
Learning agile and dynamic motor skills for legged robots
Jemin Hwangbo, Joonho Lee, Alexey Dosovitskiy et al. · Science Robotics · 2019 · 1.4K citations · Full text
Stable-Baselines3: Reliable Reinforcement Learning Implementations
Antonin Raffin, Ashley Hill, Adam Gleave et al. · elib (German Aerospace Center) · 2021 · 1K citations
Sim-to-Real Transfer of Robotic Control with Dynamics Randomization
2018 · 793 citations · Full text