2018 · 592 citations · 43 references
ComputingComputer ScienceComputer VisionMachine LearningMachine VisionDeep LearningInstance SegmentationObject DetectionPoint Cloud ProcessingScene UnderstandingSemantic Segmentation3D Instance Segmentation3D Semantic SegmentationInstance Segmentation EvaluationObject SegmentationPoint Cloud SegmentationSimilarity Matrix Analysis
The paper proposes SGPN, a deep learning framework for 3D point‑cloud instance segmentation. SGPN predicts point‑grouping proposals and semantic labels with a single network, using a similarity matrix of point embeddings to generate accurate grouping proposals. Experiments show SGPN improves 3D instance segmentation, object detection, and semantic segmentation, and can incorporate 2D CNN features to further boost performance.
We introduce Similarity Group Proposal Network (SGPN), a simple and intuitive deep learning framework for 3D object instance segmentation on point clouds. SGPN uses a single network to predict point grouping proposals and a corresponding semantic class for each proposal, from which we can directly extract instance segmentation results. Important to the effectiveness of SGPN is its novel representation of 3D instance segmentation results in the form of a similarity matrix that indicates the similarity between each pair of points in embedded feature space, thus producing an accurate grouping proposal for each point. Experimental results on various 3D scenes show the effectiveness of our method on 3D instance segmentation, and we also evaluate the capability of SGPN to improve 3D object detection and semantic segmentation results. We also demonstrate its flexibility by seamlessly incorporating 2D CNN features into the framework to boost performance.
43
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Ross Girshick, Jeff Donahue, Trevor Darrell et al. · 2014 · 31.8K citations
Kaiming He, Georgia Gkioxari, Piotr Dollár et al. · 2017 · 28.8K citations
Feature Pyramid Networks for Object Detection
Tsung-Yi Lin, Piotr Dollár, Ross Girshick et al. · 2017 · 28.7K citations