IEEE Transactions on Pattern Analysis and Machine Intelligence · 2019 · 34 citations · 61 references
ComputingVision ScienceComputer VisionMachine VisionRendering3D ReconstructionDepth EstimationImage SynthesisScene ReconstructionBackground RemovalDepth Map ReconstructionForeground RemovalImage InpaintingInpaintingMotion CompensationTemporal ConsistencyView Synthesis
This paper proposes a disocclusion inpainting framework for depth-based view synthesis. It consists of four modules: foreground extraction, motion compensation, improved background reconstruction, and inpainting. The foreground extraction module detects the foreground objects and removes them from both depth map and rendered video; the motion compensation module guarantees the background reconstruction model to suit for moving camera scenarios; the improved background reconstruction module constructs a stable background video by exploiting the temporal correlation information in both 2D video and its corresponding depth map; and the constructed background video and inpainting module are used to eliminate the holes in the synthesized view. The analysis and experiment indicate that the proposed framework has good generality, scalability and effectiveness, which means most of the existing background reconstruction methods and image inpainting methods can be employed or extended as the modules in our framework. Our comparison results have demonstrated that the proposed framework achieves better synthesized quality, temporal consistency, and has lower running time compared to the other methods.
61
Image quality assessment: from error visibility to structural similarity
Zhou Wang, Alan C. Bovik, Hamid R. Sheikh et al. · IEEE Transactions on Image Processing · 2004 · 56K citations
Martin A. Fischler, Robert C. Bolles · Communications of the ACM · 1981 · 25.5K citations · Full text
Bilateral filtering for gray and color images
Carlo Tomasi, Roberto Manduchi · 2002 · 8.1K citations
Arts, Vision Science, Color Vision +16
Adaptive background mixture models for real-time tracking
Chris Stauffer, W. Eric L. Grimson · 2003 · 6.9K citations