2010 · 70 citations · 21 references
ComputingComputer ScienceComputer VisionMachine VisionMotion EstimationMulti-view GeometryOptical FlowScene ReconstructionScene UnderstandingStereo VisionOptical Flow EstimationScene FlowVariational Optical Flow
We present a novel method for recovering the 3D structure and scene flow from calibrated multi-view sequences. We propose a 3D point cloud parametrization of the 3D structure and scene flow that allows us to directly estimate the desired unknowns. A unified global energy functional is proposed to incorporate the information from the available sequences and simultaneously recover both depth and scene flow. The functional enforces multi-view geometric consistency and imposes brightness constancy and piece-wise smoothness assumptions directly on the 3D unknowns. It inherently handles the challenges of discontinuities, occlusions, and large displacements. The main contribution of this work is the fusion of a 3D representation and an advanced variational framework that directly uses the available multi-view information. The minimization of the functional is successfully obtained despite the non-convex optimization problem. The proposed method was tested on real and synthetic data.
21
High-accuracy stereo depth maps using structured light
Daniel Scharstein, Richard Szeliski · 2003 · 1.5K citations
S. Vedula, Simon Baker, Peter Rander et al. · 1999 · 433 citations