IEEE Transactions on Automation Science and Engineering · 2015 · 107 citations · 51 references
ComputingCloud ComputingComputer ScienceArtificial IntelligenceMobile RoboticsRoboticsMappingScene UnderstandingVisual SlamKnowledge-based SemanticsMap RepresentationReal-time ConstraintsRobot MappingRobotic PerceptionSemantic MapsSemantic ReasoningSemantic Scene Understanding
The RoboEarth project aims to create a knowledge‑based cloud service that turns a basic robot into an intelligent system by providing semantic mapping capabilities. The system builds a semantic map by combining an ontology of concepts with a SLAM map of geometry and object locations, grounding terminology in perception and enabling two action recipes—environment‑aware map construction and object search—executed on the robot and supported by cloud services. Experiments show that using RoboEarth’s cloud services allows a simple robot to reliably and efficiently build semantic maps, with ontology‑based reasoning reducing computation and false positives, enabling map sharing, and meeting real‑time constraints.
The vision of the RoboEarth project is to design a knowledge-based system to provide web and cloud services that can transform a simple robot into an intelligent one. In this work, we describe the RoboEarth semantic mapping system. The semantic map is composed of: 1) an ontology to code the concepts and relations in maps and objects and 2) a SLAM map providing the scene geometry and the object locations with respect to the robot. We propose to ground the terminological knowledge in the robot perceptions by means of the SLAM map of objects. RoboEarth boosts mapping by providing: 1) a subdatabase of object models relevant for the task at hand, obtained by semantic reasoning, which improves recognition by reducing computation and the false positive rate; 2) the sharing of semantic maps between robots; and 3) software as a service to externalize in the cloud the more intensive mapping computations, while meeting the mandatory hard real time constraints of the robot. To demonstrate the RoboEarth cloud mapping system, we investigate two action recipes that embody semantic map building in a simple mobile robot. The first recipe enables semantic map building for a novel environment while exploiting available prior information about the environment. The second recipe searches for a novel object, with the efficiency boosted thanks to the reasoning on a semantically annotated map. Our experimental results demonstrate that, by using RoboEarth cloud services, a simple robot can reliably and efficiently build the semantic maps needed to perform its quotidian tasks. In addition, we show the synergetic relation of the SLAM map of objects that grounds the terminological knowledge coded in the ontology.
51
Speeded-Up Robust Features (SURF)
Herbert Bay, Andreas Ess, Tinne Tuytelaars et al. · Computer Vision and Image Understanding · 2008 · 13.4K citations
Parallel Tracking and Mapping for Small AR Workspaces
Georg Klein, David W. Murray · 2007 · 4.2K citations
Noah Snavely, Steven M. Seitz, Richard Szeliski · ACM Transactions on Graphics · 2006 · 2.8K citations · Full text
Physica D Nonlinear Phenomena · 1990 · 2.6K citations · Full text