2024 · 27 citations · 34 references
EngineeringComputer ScienceSurgeryMedical RoboticsRobot LearningRoboticsImitation LearningPolicy LearningReinforcement LearningRobot-assisted SurgerySim-to-real TransferSurgical RoboticsReinforcement Learning TransferRobot SimulationRobot-assisted LearningSimulation For Robotic SurgerySurgical SimulationSurgical Simulation TrainingSurgical TrainingSynthetic Data Generation For Robotics
Physics-based simulations have accelerated progress in robot learning for driving, manipulation, and locomotion. Yet, a fast, accurate, and robust surgical simulation environment remains a challenge. In this paper, we present Orbit-Surgical, a physics-based surgical robot simulation framework with photorealistic rendering in NVIDIA Omniverse. We provide 14 benchmark surgical tasks for the da Vinci Research Kit (dVRK) and Smart Tissue Autonomous Robot (STAR) which represent common subtasks in surgical training. Orbit-Surgical leverages GPU parallelization to train reinforcement learning and imitation learning algorithms to facilitate study of robot learning to augment human surgical skills. Orbit-Surgical also facilitates realistic synthetic data generation for active perception tasks. We demonstrate Orbit-Surgical sim-to-real transfer of learned policies onto a physical dVRK robot.Project website: orbit-surgical.github.io
34
MuJoCo: A physics engine for model-based control
Emanuel Todorov, Tom Erez, Yuval Tassa · 2012 · 4.4K citations
Engineering, Mechanical Engineering, Robotics Engineering +17
Stable-Baselines3: Reliable Reinforcement Learning Implementations
Antonin Raffin, Ashley Hill, Adam Gleave et al. · elib (German Aerospace Center) · 2021 · 1K citations
Supervised autonomous robotic soft tissue surgery
Azad Shademan, Ryan Decker, Justin D. Opfermann et al. · Science Translational Medicine · 2016 · 601 citations
Learning ambidextrous robot grasping policies
Jeffrey Mahler, Matthew Matl, Vishal Satish et al. · Science Robotics · 2019 · 578 citations