Recent Advances and Perspectives in Deep Learning Techniques for 3D Point Cloud Data Processing

Zifeng Ding, Yuxuan Sun, Yan Pan, Yanhong Peng, Zebing Mao

Robotics · 2023 · 40 citations · 96 references

DOIFull text

Open access

Concepts

TL;DR

Deep learning for 3D point cloud data has advanced rapidly, enabling feature extraction from unstructured data and supporting applications in robotics, autonomous vehicles, and other computer‑vision domains, while evolving through diverse architectures, learning algorithms, and datasets that now form a comprehensive state‑of‑the‑art landscape with broad cross‑disciplinary potential. This paper reviews recent literature on key tasks—3D object classification, tracking, pose estimation, segmentation, and point cloud completion—and critically evaluates current limitations and challenges while identifying future research directions. The review surveys recent literature, examines diverse model architectures, learning algorithms, and training datasets, and evaluates transformative methods such as PoinTr and SnowflakeNet. The review fills a knowledge gap by providing a focused, comprehensive synthesis of recent research on deep learning techniques for 3D point cloud processing, serving as a valuable resource for both novice and experienced researchers.

Abstract

In recent years, deep learning techniques for processing 3D point cloud data have seen significant advancements, given their unique ability to extract relevant features and handle unstructured data. These techniques find wide-ranging applications in fields like robotics, autonomous vehicles, and various other computer-vision applications. This paper reviews the recent literature on key tasks, including 3D object classification, tracking, pose estimation, segmentation, and point cloud completion. The review discusses the historical development of these methods, explores different model architectures, learning algorithms, and training datasets, and provides a comprehensive summary of the state-of-the-art in this domain. The paper presents a critical evaluation of the current limitations and challenges in the field, and identifies potential areas for future research. Furthermore, the emergence of transformative methodologies like PoinTr and SnowflakeNet is examined, highlighting their contributions and potential impact on the field. The potential cross-disciplinary applications of these techniques are also discussed, underscoring the broad scope and impact of these developments. This review fills a knowledge gap by offering a focused and comprehensive synthesis of recent research on deep learning techniques for 3D point cloud data processing, thereby serving as a useful resource for both novice and experienced researchers in the field.

References

96