arXiv (Cornell University) · 2019 · 11 citations · 32 references
ComputingComputer ScienceComputational GeometryComputer VisionMachine Vision3D ReconstructionCoordinate TransformationsGeometry ProcessingImage RegistrationPoint Cloud ProcessingPose Estimation3D Pose EstimationDeep Learning-based RegistrationPoint Cloud AlignmentPoint Cloud EncodingPoint Cloud Representation LearningPoint Cloud TrackingShape Completion
PointNet has recently emerged as a popular representation for unstructured point cloud data, allowing application of deep learning to tasks such as object detection, segmentation and shape completion. However, recent works in literature have shown the sensitivity of the PointNet representation to pose misalignment. This paper presents a novel framework that uses PointNet encoding to align point clouds and perform registration for applications such as 3D reconstruction, tracking and pose estimation. We develop a framework that compares PointNet features of template and source point clouds to find the transformation that aligns them accurately. In doing so, we avoid computationally expensive correspondence finding steps, that are central to popular registration methods such as ICP and its variants. Depending on the prior information about the shape of the object formed by the point clouds, our framework can produce approaches that are shape specific or general to unseen shapes. Our framework produces approaches that are robust to noise and initial misalignment in data and work robustly with sparse as well as partial point clouds. We perform extensive simulation and real-world experiments to validate the efficacy of our approach and compare the performance with state-of-art approaches. Code is available at https://github.com/vinits5/pointnet-registrationframework.
32
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Raffaelli Charles, Hao Su, Kaichun Mo et al. · 2017 · 9.8K citations
3D ShapeNets: A deep representation for volumetric shapes
Zhirong Wu, Shuran Song, Aditya Khosla et al. · 2015 · 4.7K citations · Full text
VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection
Yin Zhou, Oncel Tuzel · 2018 · 4.6K citations
Fast Point Feature Histograms (FPFH) for 3D registration
Radu Bogdan Rusu, Nico Blodow, Michael Beetz · 2009 · 3.8K citations
Efficient variants of the ICP algorithm
Szymon Rusinkiewicz, Marc Levoy · 2002 · 3.7K citations