2021 · 13 citations · 27 references
EngineeringComputer ScienceRobotics EngineeringMarkov Decision ProcessesRobot ControlRoboticsData-efficient Robot LearningManipulation ControlManipulation LearningPolicy LearningReinforcement LearningRobot ManipulationContact-rich ManipulationManipulation In Unstructured EnvironmentsRandom Access Memory (Ram)Random-access MemoryReinforcement Learning For ManipulationReinforcement Learning For RoboticsSample EfficiencySample-efficient Robot Learning
Contact-rich manipulation tasks are commonly found in modern manufacturing settings. However, manually designing a robot controller is considered hard for traditional control methods as the controller requires an effective combination of modalities and vastly different characteristics. In this paper, we first consider incorporating operational space visual and haptic information into a reinforcement learning (RL) method to solve the target uncertainty problems in unstructured environments. Moreover, we propose a novel idea of introducing a proactive action to solve a partially observable Markov decision process (POMDP) problem. With these two ideas, our method can either adapt to reasonable variations in unstructured environments or improve the sample efficiency of policy learning. We evaluated our method on a task that involved inserting a random-access memory (RAM) using a torque-controlled robot and tested the success rates of different baselines used in the traditional methods. We proved that our method is robust and can tolerate environmental variations.
27
The DLR lightweight robot: design and control concepts for robots in human environments
Alin Albu‐Schäffer, Sami Haddadin, Andreas Stemmer et al. · Industrial Robot the international journal of robotics research and application · 2007 · 616 citations · Full text
Engineering, Mechanical Engineering, Robotics Engineering +17