2024 · 10 citations · 23 references
EngineeringComputer ScienceRobotics EngineeringHumanoid RoboticsRobot ControlRoboticsImitation LearningManipulation ControlRobot ManipulationTeleoperationWhole-body ControlWhole-body CoordinationBehavior CloningContact-rich ManipulationLearning By ImitationLearning From TeleoperationRobot GraspingRobot TeleoperationTeleoperation AssistanceWhole-body Manipulation
Humanoid robots could benefit from using their upper bodies for support contacts, enhancing their workspace, stability, and ability to perform contact-rich and pushing tasks. In this paper, we propose a unified approach that combines an optimization-based multi-contact whole-body controller with Flow Matching, a recently introduced method capable of generating multi-modal trajectory distributions for imitation learning. In simulation, we show that Flow Matching is more appropriate for robotics than Diffusion and traditional behavior cloning. On a real full-size humanoid robot (Talos), we demonstrate that our approach can learn a whole-body non-prehensile box-pushing task and that the robot can close dishwasher drawers by adding contacts with its free hand when needed for balance. We also introduce a shared autonomy mode for assisted teleoperation, providing automatic contact placement for tasks not covered in the demonstrations. Full experimental videos are available at: https://hucebot. github.io/flow_multisupport_website/
23
Denoising Diffusion Probabilistic Models
arXiv (Cornell University) · 2020 · 5.6K citations · Full text
A survey of robot learning from demonstration
Brenna Argall, Sonia Chernova, Manuela Veloso et al. · Robotics and Autonomous Systems · 2008 · 3.3K citations
Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware
Tony Z. Zhao, Vikas Kumar, Sergey Levine et al. · 2023 · 448 citations · Full text
Probabilistic Movement Primitives
Alexandros Paraschos, Christian Daniel, Jan Peters et al. · Lincoln Repository (University of Lincoln) · 2013 · 413 citations · Full text
Diffusion Policy: Visuomotor Policy Learning via Action Diffusion
Cheng Chi, Siyuan Feng, Yilun Du et al. · 2023 · 411 citations · Full text