IEEE Transactions on Pattern Analysis and Machine Intelligence · 2021 · 11 citations · 50 references
ComputingVision ScienceComputer VisionMachine VisionRendering3D ReconstructionGeometry ProcessingMulti-view GeometryRendering PipelineStereo VisionSurface ReconstructionDeformable ModelsImplicit Surface RepresentationMulti-view ReconstructionMulti-view StereoMulti-view Stereo ReconstructionMultiview StereoScene Reconstruction From ImagesStereopsis
The recent success in supervised multi-view stereopsis (MVS) relies on the onerously collected real-world 3D data. While the latest differentiable rendering techniques enable unsupervised MVS, they are restricted to discretized (e.g., point cloud) or implicit geometric representation, suffering from either low integrity for a textureless region or less geometric details for complex scenes. In this paper, we propose SurRF, an unsupervised MVS pipeline by learning Surface Radiance Field, i.e., a radiance field defined on a continuous and explicit 2D surface. Our key insight is that, in a local region, the explicit surface can be gradually deformed from a continuous initialization along view-dependent camera rays by differentiable rendering. That enables us to define the radiance field only on a 2D deformable surface rather than in a dense volume of 3D space, leading to compact representation while maintaining complete shape and realistic texture for large-scale complex scenes. We experimentally demonstrate that the proposed SurRF produces competitive results over the-state-of-the-art on various real-world challenging scenes, without any 3D supervision. Moreover, SurRF shows great potential in owning the joint advantages of mesh (scene manipulation), continuous surface (high geometric resolution), and radiance field (realistic rendering).
50
Ben Mildenhall, Pratul P. Srinivasan, Matthew Tancik et al. · Communications of the ACM · 2021 · 5.8K citations · Full text
Structure-from-Motion Revisited
Johannes L. Schönberger, Jan‐Michael Frahm · 2016 · 5.8K citations
3D ShapeNets: A deep representation for volumetric shapes
Zhirong Wu, Shuran Song, Aditya Khosla et al. · 2015 · 4.7K citations · Full text
A volumetric method for building complex models from range images
Brian Curless, Marc Levoy · 1996 · 3.1K citations