ACM Transactions on Graphics · 2006 · 153 citations · 37 references
ComputingVision ScienceComputer VisionDigital ImagingMachine VisionCamera ProjectionDepth EstimationDepth Of FieldImage SynthesisPerspective ProjectionScene ReconstructionCamera SystemsDepth Map ReconstructionDynamic Scene CaptureFrequency Domain ProcessingImage DisplayImage-based CompositionProjector-camera SystemsScene Depth Reconstruction
In order to produce bright images, projectors have large apertures and hence narrow depths of field. In this paper, we present methods for robust scene capture and enhanced image display based on projection defocus analysis. We model a projector's defocus using a linear system. This model is used to develop a novel temporal defocus analysis method to recover depth at each camera pixel by estimating the parameters of its projection defocus kemel in frequency domain. Compared to most depth recovery methods, our approach is more accurate near depth discontinuities. Furthermore, by using a coaxial projector-camera system, we ensure that depth is computed at all camera pixels, without any missing parts. We show that the recovered scene geometry can be used for refocus synthesis and for depth-based image composition. Using the same projector defocus model and estimation technique, we also propose a defocus compensation method that filters a projection image in a spatially-varying, depth-dependent manner to minimize its defocus blur after it is projected onto the scene. This method effectively increases the depth of field of a projector without modifying its optics. Finally, we present an algorithm that exploits projector defocus to reduce the strong pixelation artifacts produced by digital projectors, while preserving the quality of the projected image. We have experimentally verified each of our methods using real scenes.
37
Three-dimensional computer vision: a geometric viewpoint
Choice Reviews Online · 1994 · 3.1K citations
High-accuracy stereo depth maps using structured light
Daniel Scharstein, Richard Szeliski · 2003 · 1.5K citations
Shree K. Nayar, Yasuo Nakagawa · IEEE Transactions on Pattern Analysis and Machine Intelligence · 1994 · 1.2K citations