2017 · 169 citations · 25 references
ComputingVisualizationComputer VisionDigital RenderingImmersive Visualization3D Reconstruction3D RenderingImmersive MediaMotion CaptureStereo VisionVirtual Reality360-Degree VideoDense 3D ReconstructionDense ReconstructionNovel View RenderingReconstruction AlgorithmsTranslational MotionViewsWarping
Recent breakthroughs in consumer level virtual reality (VR) headsets are creating a growing user-base in demand for immersive, full 3D VR experiences. While monoscopic 360-videos are perhaps the most prevalent type of content for VR headsets, they lack 3D information and thus cannot be viewed with full 6 degree-of-freedom (DOF). We present an approach that addresses this limitation via a novel warping algorithm that can synthesize new views both with rotational and translational motion of the viewpoint. This enables the ability to perform VR playback of input monoscopic 360-videos files in full stereo with full 6-DOF of head motion. Our method synthesizes novel views for each eye in accordance with the 6-DOF motion of the headset. Our solution tailors standard structure-from-motion and dense reconstruction algorithms to work accurately for 360-videos and is optimized for GPUs to achieve VR frame rates (>120 fps). We demonstrate the effectiveness our approach on a variety of videos with interesting content.
25
Noah Snavely, Steven M. Seitz, Richard Szeliski · ACM Transactions on Graphics · 2006 · 2.8K citations · Full text
Detection and Tracking of Point Features
Carlo Tomasi · 1991 · 2.2K citations
Multi-View Stereo for Community Photo Collections
Michael Goesele, Noah Snavely, Brian Curless et al. · 2007 · 732 citations