2012 · 32 citations · 24 references
ComputingComputer Science3D ModelingComputer VisionMachine Vision3D Imaging3D ReconstructionMotion EstimationMulti-view GeometryScene ReconstructionVolume RegistrationDense 3D ReconstructionDense Motion EstimationDynamic Scene ReconstructionMotion Field EstimationRegistrationScene FlowStructure From MotionVolumetric Representation
We propose a method for estimating the 3D structure and the dense 3D motion (scene flow) of a dynamic nonrigid 3D scene, using a camera array. The core idea is to use a dense multi-camera array to construct a novel, dense 3D volumetric representation of the 3D space where each voxel holds an estimated intensity value and a confidence measure of this value. The problem of 3D structure and 3D motion estimation of a scene is thus reduced to a nonrigid registration of two volumes - hence the term ”Scene Registration”. Registering two dense 3D scalar volumes does not require recovering the 3D structure of the scene as a preprocessing step, nor does it require explicit reasoning about occlusions. From this nonrigid registration we accurately extract the 3D scene flow and the 3D structure of the scene, and successfully recover the sharp discontinuities in both time and space. We demonstrate the advantages of our method on a number of challenging synthetic and real data sets.
24
Berthold K. P. Horn, Brian G. Schunck · Artificial Intelligence · 1981 · 9.9K citations · Full text
A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms
Steven M. Seitz, Brian Curless, James Diebel et al. · 2006 · 2.4K citations
A Database and Evaluation Methodology for Optical Flow
Simon Baker, Daniel Scharstein, John Lewis et al. · International Journal of Computer Vision · 2010 · 2.2K citations · Full text
Secrets of optical flow estimation and their principles
Deqing Sun, Stefan Roth, Michael J. Black · 2010 · 1.4K citations