2018 · 38 citations · 13 references
ComputingComputer ScienceRobotics EngineeringComputer VisionMachine LearningRobot VisionObject DetectionObject RecognitionPick-and-place AutomationRobotic VisionScene UnderstandingSim-to-real TransferAutoencodersPositionSynthetic-to-real Lighting Transfer
Capturing and labeling camera images in the real world is an expensive task, whereas synthesizing labeled images in a simulation environment is easy for collecting large-scale image data. However, learning from only synthetic images may not achieve the desired performance in the real world due to a gap between synthetic and real images. We propose a method that transfers learned detection of an object position from a simulation environment to the real world. This method uses only a significantly limited dataset of real images while leveraging a large dataset of synthetic images using variational autoen-coders. Additionally, the proposed method consistently performed well in different lighting conditions, in the presence of other distractor objects, and on different backgrounds. Experimental results showed that it achieved accuracy of 1.5 mm to 3.5 mm on average. Furthermore, we showed how the method can be used in a real-world scenario like a “pick-and-place” robotic task.
13
Auto-Encoding Variational Bayes
Diederik P. Kingma, Max Welling · UvA-DARE (University of Amsterdam) · 2013 · 15.6K citations · Full text
Learning Deep Object Detectors from 3D Models
Xingchao Peng, Baochen Sun, Karim Ali et al. · 2015 · 350 citations
Eder Santana, George Hotz · arXiv (Cornell University) · 2016 · 183 citations · Full text