2017 · 177 citations · 35 references
ArchitectureVisualization3D ModelingComputer VisionGeometric Modeling3D ReconstructionGeometry ProcessingShape InterpolationShape RepresentationSurface ModelingSurface Reconstruction3D Shape ReconstructionConvolutionConvolutional Neural NetworksNon-rigid ReconstructionParametric RepresentationResidual NetworksShapeShape Reconstruction
3D shape models are naturally parameterized using vertices and faces, i.e., composed of polygons forming a surface. However, current 3D learning paradigms for predictive and generative tasks using convolutional neural networks focus on a voxelized representation of the object. Lifting convolution operators from the traditional 2D to 3D results in high computational overhead with little additional benefit as most of the geometry information is contained on the surface boundary. Here we study the problem of directly generating the 3D shape surface of rigid and non-rigid shapes using deep convolutional neural networks. We develop a procedure to create consistent `geometry images' representing the shape surface of a category of 3D objects. We then use this consistent representation for category-specific shape surface generation from a parametric representation or an image by developing novel extensions of deep residual networks for the task of geometry image generation. Our experiments indicate that our network learns a meaningful representation of shape surfaces allowing it to interpolate between shape orientations and poses, invent new shape surfaces and reconstruct 3D shape surfaces from previously unseen images. Our code is available at https://github.com/sinhayan/surfnet.
35
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
On Spectral Clustering: Analysis and an algorithm
Andrew Y. Ng, Michael I. Jordan, Yair Weiss · 2001 · 7.8K citations
3D ShapeNets: A deep representation for volumetric shapes
Zhirong Wu, Shuran Song, Aditya Khosla et al. · 2015 · 4.7K citations · Full text
ShapeNet: An Information-Rich 3D Model Repository
Thomas Funkhouser, Leonidas Guibas, Pat Hanrahan et al. · arXiv (Cornell University) · 2015 · 2.4K citations · Full text
Robert Osada, Thomas Funkhouser, Bernard Chazelle et al. · ACM Transactions on Graphics · 2002 · 1.7K citations