arXiv (Cornell University) · 2018 · 58 citations · 63 references
Open access
ComputingComputer ScienceComputational GeometryComputer VisionMachine Learning3D ReconstructionDeep LearningObject RecognitionRepresentation LearningScene ReconstructionScene Understanding3D Scene Understanding3D Semantic SegmentationConvolutional Neural Network SegmentationNon-euclidean Transformations
3D data provides rich geometric information, and recent advances in large datasets and computing power now enable deep‑learning methods for tasks such as segmentation, recognition, and correspondence, though the challenges vary with the chosen representation. The paper surveys 3D data representations, contrasting Euclidean and non‑Euclidean forms. It reviews how deep‑learning techniques are applied to each representation and the specific challenges involved. The survey identifies key challenges and gaps in applying deep learning across different 3D data representations.
3D data is a valuable asset the computer vision filed as it provides rich information about the full geometry of sensed objects and scenes. Recently, with the availability of both large 3D datasets and computational power, it is today possible to consider applying deep learning to learn specific tasks on 3D data such as segmentation, recognition and correspondence. Depending on the considered 3D data representation, different challenges may be foreseen in using existent deep learning architectures. In this work, we provide a comprehensive overview about various 3D data representations highlighting the difference between Euclidean and non-Euclidean ones. We also discuss how Deep Learning methods are applied on each representation, analyzing the challenges to overcome.
63
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
ImageNet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 61.8K citations
Fully convolutional networks for semantic segmentation
Jonathan Long, Evan Shelhamer, Trevor Darrell · 2015 · 36.9K citations
Extreme learning machine: Theory and applications
Guang-Bin Huang, Qinyu Zhu, Chee‐Kheong Siew · Neurocomputing · 2006 · 13.2K citations