Transport and Rendering Challenges of Multi-Stream, 3D Tele-Immersion Data

Abstract

For over four years, our colleagues at the University of Pennsylvania and we have been developing an experimental 3D tele-immersion testbed with the goal of providing high-fidelity scene reconstruction coupled with lifesize, view-dependent stereo display. The UPenn team has focused on stereo reconstruction algorithms, while UNC has worked on system architecture, network transport, and stereo rendering and display issues. This paper provides an overview of our testbed architecture and details the transport and rendering challenges and solutions we have explored.