Proceedings of the ACM on Computer Graphics and Interactive Techniques · 2020 · 11 citations · 32 references
ComputingVisualizationComputer VisionReal-time RenderingRendering3D Reconstruction3D RenderingImage-based RenderingMulti-view GeometryScene ReconstructionStereo Vision3D Scene RenderingLabelsMulti-view ReconstructionMulti-view StereoMulti-view Stereo ReconstructionRefinementScene Reconstruction From ImagesScene Representation
Image-Based Rendering (IBR) has made impressive progress towards highly realistic, interactive 3D navigation for many scenes, including cityscapes. However, cars are ubiquitous in such scenes; multi-view stereo reconstruction provides proxy geometry for IBR, but has difficulty with shiny car bodies, and leaves holes in place of reflective, semi-transparent windows on cars. We present a new approach allowing free-viewpoint IBR of cars based on an approximate analytic reflection flow computation on curved windows. Our method has three components: a refinement step of reconstructed car geometry guided by semantic labels, that provides an initial approximation for missing window surfaces and a smooth completed car hull; an efficient reflection flow computation using an ellipsoid approximation of the curved car windows that runs in real-time in a shader and a reflection/background layer synthesis solution. These components allow plausible rendering of reflective, semi-transparent windows in free viewpoint navigation. We show results on several scenes casually captured with a single consumer-level camera, demonstrating plausible car renderings with significant improvement in visual quality over previous methods.
32
Liang-Chieh Chen, George Papandreou, Iasonas Kokkinos et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2017 · 22.1K citations
ORB: An efficient alternative to SIFT or SURF
Ethan Rublee, Vincent Rabaud, Kurt Konolige et al. · 2011 · 10.4K citations
Structure-from-Motion Revisited
Johannes L. Schönberger, Jan‐Michael Frahm · 2016 · 5.8K citations
Marc Levoy, Pat Hanrahan · 1996 · 3.7K citations · Full text