2018 · 36 citations · 24 references
ComputingAutonomous SystemsComputer ScienceArtificial IntelligenceAutonomous VehiclesComputer VisionDeep LearningGraph-based LearningNatural Language UnderstandingScene ReconstructionScene UnderstandingSemantic SegmentationEarley ParsingRoad Scene UnderstandingScene Graph GenerationScene Graph RepresentationScene GraphsScene ParsingSemantic Scene ParsingSemantic Scene Reconstruction
Autonomous vehicles require an accurate and adequate representation of their environment for decision making and planning in real-world driving scenarios. While deep learning methods have come a long way providing accurate semantic segmentation of scenes, they are still limited to pixel-wise outputs and do not naturally support high-level reasoning and planning methods that are required for complex road manoeuvres. In contrast, we introduce a hierarchical, graph-based representation, called scene graph, which is reconstructed from a partial, pixel-wise segmentation of an image, and which can be linked to domain knowledge and AI reasoning techniques. In this work, we use an adapted version of the Earley parser and a learnt probabilistic grammar to generate scene graphs from a set of segmented entities. Scene graphs model the structure of the road using an abstract, logical representation which allows us to link them with background knowledge. As a proof-of-concept we demonstrate how parts of a parsed scene can be inferred and classified beyond labelled examples by using domain knowledge specified in the Highway Code. By generating an interpretable representation of road scenes and linking it to background knowledge, we believe that this approach provides a vital step towards explainable and auditable models for planning and decision making in the context of autonomous driving.
24
Hengshuang Zhao, Jianping Shi, Xiaojuan Qi et al. · 2017 · 15.5K citations
The Description Logic Handbook – Theory, Implementation and Applications
C.J.H. Mann · Kybernetes · 2003 · 2.2K citations
A Spatial Logic based on Regions and Connection.
David Randell, Zhanfeng Cui, Anthony G. Cohn · 1992 · 1.9K citations
Computing, Geoinformatics, Geographic Information Science +11
1 year, 1000 km: The Oxford RobotCar dataset
Will Maddern, Geoffrey Pascoe, Chris Linegar et al. · The International Journal of Robotics Research · 2016 · 1.6K citations