ACM Transactions on Graphics · 2016 · 225 citations · 34 references
ArchitectureArchitectural DesignArchitectural VisualizationArchitectural DrawingDrawingInteractive VisualizationInterface DesignTangible User InterfacesRecognition ErrorsTangible Information VisualizationVisual Scene DescriptionVisual Scene OrganizationVisual Scene UnderstandingZoomingZooming Techniques
We present Jump, a practical system for capturing high resolution, omnidirectional stereo (ODS) video suitable for wide scale consumption in currently available virtual reality (VR) headsets. Our system consists of a video camera built using off-the-shelf components and a fully automatic stitching pipeline capable of capturing video content in the ODS format. We have discovered and analyzed the distortions inherent to ODS when used for VR display as well as those introduced by our capture method and show that they are small enough to make this approach suitable for capturing a wide variety of scenes. Our stitching algorithm produces robust results by reducing the problem to one of pairwise image interpolation followed by compositing. We introduce novel optical flow and compositing methods designed specifically for this task. Our algorithm is temporally coherent and efficient, is currently running at scale on a distributed computing platform, and is capable of processing hours of footage each day.
34
Berthold K. P. Horn, Brian G. Schunck · Artificial Intelligence · 1981 · 9.9K citations · Full text
Marc Levoy, Pat Hanrahan · 1996 · 3.7K citations · Full text
A Database and Evaluation Methodology for Optical Flow
Simon Baker, Daniel Scharstein, John Lewis et al. · International Journal of Computer Vision · 2010 · 2.2K citations · Full text
Object scene flow for autonomous vehicles
Moritz Menze, Andreas Geiger · 2015 · 2.2K citations