Proceedings of the AAAI Conference on Artificial Intelligence · 2021 · 24 citations · 41 references
ComputingComputer ScienceComputational GeometryComputer VisionMachine LearningGeometry ProcessingObject RecognitionPoint Cloud ProcessingShape RepresentationCatastrophic ForgettingClass-incremental LearningIncremental LearningObject ClassificationObject-based LearningPoint Cloud ClassificationPoint Cloud RepresentationPoint Cloud Representation Learning
3D object classification has attracted appealing attentions in academic researches and industrial applications. However, most existing methods need to access the training data of past 3D object classes when facing the common real-world scenario: new classes of 3D objects arrive in a sequence. Moreover, the performance of advanced approaches degrades dramatically for past learned classes (i.e., catastrophic forgetting), due to the irregular and redundant geometric structures of 3D point cloud data. To address these challenges, we propose a new Incremental 3D Object Learning (i.e., I3DOL) model, which is the first exploration to learn new classes of 3D object continually. Specifically, an adaptive-geometric centroid module is designed to construct discriminative local geometric structures, which can better characterize the irregular point cloud representation for 3D object. Afterwards, to prevent the catastrophic forgetting brought by redundant geometric information, a geometric-aware attention mechanism is developed to quantify the contributions of local geometric structures, and explore unique 3D geometric characteristics with high contributions for classes incremental learning. Meanwhile, a score fairness compensation strategy is proposed to further alleviate the catastrophic forgetting caused by unbalanced data between past and new classes of 3D object, by compensating biased prediction for new classes in the validation phase. Experiments on 3D representative datasets validate the superiority of our I3DOL framework.
41
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Raffaelli Charles, Hao Su, Kaichun Mo et al. · 2017 · 9.8K citations
Deformable Convolutional Networks
Jifeng Dai, Haozhi Qi, Yuwen Xiong et al. · 2017 · 6.9K citations
Dynamic Graph CNN for Learning on Point Clouds
Yue Wang, Yongbin Sun, Ziwei Liu et al. · ACM Transactions on Graphics · 2019 · 6.7K citations · Full text
3D ShapeNets: A deep representation for volumetric shapes
Zhirong Wu, Shuran Song, Aditya Khosla et al. · 2015 · 4.7K citations · Full text