Production framework for full panoramic scenes with photorealistic augmented reality

Abstract

The novelty of our workflow is the end-to-end solution to combine captured panoramas and computer generated elements. This pipeline supports productions specially aiming at spherical displays (e.g., fulldomes). Full panoramas have been used in computer graphics for years, yet their common usage lays on environment lighting and reflection maps for conventional displays. With a keen eye in what may be the next trend in the filmmaking industry, we address the particularities of those productions, proposing a new representation of the space by storing the depth together with the light maps, in a full panoramic light-depth map.