IEEE Robotics and Automation Letters · 2020 · 35 citations · 17 references
EngineeringComputer ScienceRobotics EngineeringComputer VisionRobot VisionRoboticsMachine Vision For RoboticsObject ManipulationPose EstimationRobot ManipulationRobotic Vision3D Pose Estimation6D Object Pose Estimation6D Pose EstimationManipulationManipulation In Unstructured EnvironmentsObject Pose EstimationObjectsSensing
In this letter we propose a robotic vision task with the goal of enabling robots to execute complex assembly tasks in unstructured environments using a camera as the primary sensing device. We formulate the task as an instance of 6D pose estimation of template geometries, to which manipulation objects should be connected. In contrast to the standard 6D pose estimation task, this requires reasoning about local geometry that is surrounded by arbitrary context, such as a power outlet embedded into a wall. We propose a deep learning based approach to solve this task alongside a novel dataset that will enable future work in this direction and can serve as a benchmark. We experimentally show that state-of-the-art 6D pose estimation methods alone are not sufficient to solve the task but that our training procedure significantly improves the performance of deep learning techniques in this context.
17
Gary Bradski · Medical Entomology and Zoology · 2000 · 3.1K citations
Domain randomization for transferring deep neural networks from simulation to the real world
Josh Tobin, Rachel Fong, Alex Ray et al. · 2017 · 2.8K citations
Describing Textures in the Wild
Mircea Cimpoi, Subhransu Maji, Iasonas Kokkinos et al. · 2014 · 2.2K citations · Full text