2021 · 223 citations · 18 references
ComputingComputer Science3D ModelingComputational GeometryComputer Vision3D Imaging3D ReconstructionGeometry ProcessingPoint Cloud ProcessingScene ReconstructionSurface ReconstructionConvolutionData SparsityOctree DecompositionPoint Cloud CompressionPoint Cloud EncodingPoint Cloud ReconstructionSparsity ConstraintsVideo Compression
Recent years have witnessed the growth of point cloud based applications for both immersive media as well as 3D sensing for auto-driving, because of its realistic and fine-grained representation of 3D objects and scenes. However, it is a challenging problem to compress sparse, unstructured, and high-precision 3D points for efficient communication. In this paper, leveraging the sparsity nature of the point cloud, we propose a multiscale end-to-end learning framework that hierarchically reconstructs the 3D Point Cloud Geometry (PCG) via progressive re-sampling. The framework is developed on top of a sparse convolution based autoencoder for point cloud compression and reconstruction. For the input PCG which has only the binary occupancy attribute, our framework translates it to a down-scaled point cloud at the bottleneck layer which possesses both geometry and associated feature attributes. Then, the geometric occupancy is losslessly compressed using an octree codec and the feature attributes are lossy compressed using a learned probabilistic context model. Compared with the state-of-the-art Video-based Point Cloud Compression (V-PCC) and Geometry-based PCC (G-PCC) schemes standardized by the Moving Picture Experts Group (MPEG), our method achieves more than 40% and 70% BD-Rate (BjØntegaard Delta Rate) reduction, respectively. We would like to make all materials publicly accessible at https://njuvision.github.io/PCGCv2/ for reproducible research.
18
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Christian Szegedy, Sergey Ioffe, Vincent Vanhoucke et al. · 2017 · 12.6K citations · Full text
ShapeNet: An Information-Rich 3D Model Repository
Thomas Funkhouser, Leonidas Guibas, Pat Hanrahan et al. · arXiv (Cornell University) · 2015 · 2.4K citations · Full text
Variational image compression with a scale hyperprior
Johannes Ballé, David Minnen, Saurabh Singh et al. · arXiv (Cornell University) · 2018 · 1.1K citations · Full text
Variational image compression with a scale hyperprior
David Minnen, Saurabh Singh, Sung Jin Hwang et al. · arXiv (Cornell University) · 2018 · 861 citations · Full text
ACM Transactions on Graphics · 2017 · 843 citations · Full text