AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation System

Abstract

Yuzhe Qin was an intern at NVIDIA during the project.experiments, AnyTeleop can outperform a previous system that was designed for a specific robot hardware with a higher success rate, using the same robot.For teleoperation in simulation, AnyTeleop leads to better imitation learning performance, compared with a previous system that is particularly designed for that simulator.Robot 1 Controlled by Operator #1 On Computer #1 Robot 2 Controlled by Operator #2 On Computer #2