2023 · 48 citations · 29 references
EngineeringComputer ScienceRobotics EngineeringHumanoid RoboticsRobot ControlRoboticsData-efficient Robot LearningImitation LearningLearning From DemonstrationPolicy LearningTeleoperationWhole-body ControlDeep Imitation LearningJoint ActuationLearning By ImitationLearning From Human DemonstrationLearning From TeleoperationManipulation Skill LearningOperatorsRobot Learning From Demonstration
We tackle the problem of developing humanoid loco-manipulation skills with deep imitation learning. The difficulty of collecting task demonstrations and training policies for humanoids with a high degree of freedom presents substantial challenges. We introduce TRILL, a data-efficient framework for training humanoid loco-manipulation policies from human demonstrations. In this framework, we collect human demonstration data through an intuitive Virtual Reality (VR) interface. We employ the whole-body control formulation to transform task-space commands by human operators into the robot's joint-torque actuation while stabilizing its dynamics. By employing high-level action abstractions tailored for humanoid loco-manipulation, our method can efficiently learn complex sensorimotor skills. We demonstrate the effectiveness of TRILL in simulation and on a real-world robot for performing various loco-manipulation tasks. Videos and additional materials can be found on the project page: https://ut-austin-rpl.github.io/TRILL.
29
MuJoCo: A physics engine for model-based control
Emanuel Todorov, Tom Erez, Yuval Tassa · 2012 · 4.4K citations
Engineering, Mechanical Engineering, Robotics Engineering +17
RT-1: Robotics Transformer for Real-World Control at Scale
Anthony Brohan, Noah Brown, Justice Carbajal et al. · 2023 · 520 citations · Full text
Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware
Tony Z. Zhao, Vikas Kumar, Sergey Levine et al. · 2023 · 448 citations · Full text