<title>Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV</title>

Christoph Fehn

Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2004 · 1.3K citations · 12 references

Concepts

TL;DR

The work is part of the European IST project ATTEST, which brings together industry, research, and academia to design a backwards‑compatible, flexible, modular broadcast 3D‑TV system. The paper aims to detail a system that introduces depth perception into existing 2D digital TV, comparing it to stereoscopic video and outlining its design and implementation. The system generates a novel data format combining monoscopic color video with per‑pixel depth, enabling real‑time synthesis of virtual views via depth‑image‑based rendering, and employs MPEG tools for backwards‑compatible compression and transmission.

Abstract

This paper presents details of a system that allows for an evolutionary introduction of depth perception into the existing 2D digital TV framework. The work is part of the European Information Society Technologies (IST) project "Advanced Three-Dimensional Television System Technologies" (ATTEST), an activity, where industries, research centers and universities have joined forces to design a backwards-compatible, flexible and modular broadcast 3D-TV system. At the very heart of the described new concept is the generation and distribution of a novel data representation format, which consists of monoscopic color video and associated per-pixel depth information. From these data, one or more "virtual" views of a real-world scene can be synthesized in real-time at the receiver side (i.e. a 3D-TV set-top box) by means of so-called depth-image-based rendering (DIBR) techniques. This publication will provide: (1) a detailed description of the fundamentals of this new approach on 3D-TV; (2) a comparison with the classical approach of "stereoscopic" video; (3) a short introduction to DIBR techniques in general; (4) the development of a specific DIBR algorithm that can be used for the efficient generation of high-quality "virtual" stereoscopic views; (5) a number of implementation details that are specific to the current state of the development; (6) research on the backwards-compatible compression and transmission of 3D imagery using state-of-the-art MPEG (Moving Pictures Expert Group) tools.

References

12