IEEE Robotics and Automation Letters · 2022 · 25 citations · 31 references
EngineeringComputer ScienceRobotics EngineeringRobot ControlRobot LearningRoboticsBioinspired LocomotionLegged LocomotionLegged Robot ControlLegged RoboticsLocomotion ControlMammalian LocomotionControl ArchitectureLegged Robot LocomotionLocomotionPeriodic Motion GenerationQuadruped LocomotionRhythmic LocomotionRhythmic Motor PatternsState Estimation For Legged Robots
The mechanisms of locomotion in mammals have been extensively studied and inspire the related researches on designing the control architectures for the legged robots. Reinforcement learning (RL) is a promising approach allowing robots to automatically learn locomotion policies. However, careful reward-function adjustments are often required via trial-and-error until achieving a desired behavior, as RL policy behaviors are sensitive to the rewards. In this paper, we draw inspiration from the rhythmic locomotion behaviors of animals and propose a new control architecture by incorporating a rhythm generator to naturally stimulate periodic motor patterns, which actively participates in the timing of phase transitions in the robot step cycle. To speed up training, we use the joint position increments rather than the conventional joint positions as the outputs of the RL policy. During deployment, the rhythm generator can be reused for the state estimation of quadruped robots. We validate our method by realizing the full spectrum of quadruped locomotion in both simulated and real-world scenarios.
31
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Yoshua Bengio, Jérôme Louradour, Ronan Collobert et al. · 2009 · 5K citations · Full text
Domain randomization for transferring deep neural networks from simulation to the real world
Josh Tobin, Rachel Fong, Alex Ray et al. · 2017 · 2.8K citations
Learning agile and dynamic motor skills for legged robots
Jemin Hwangbo, Joonho Lee, Alexey Dosovitskiy et al. · Science Robotics · 2019 · 1.4K citations · Full text