Rendering for an interactive 360° light field display

Andrew Jones, Ian E. McDowall, Hideshi Yamada, Mark Bolas, Paul Debevec

ACM Transactions on Graphics · 2007 · 241 citations · 26 references

Concepts

TL;DR

The paper presents rendering techniques for an autostereoscopic light‑field display that enables interactive 3D graphics to be viewed simultaneously by multiple observers around the display. The system uses a high‑speed projector, a spinning mirror with a holographic diffuser, and FPGA‑based DVI decoding, while a programmable graphics card renders over 5,000 images per second to produce 360‑degree views with 1.25° separation, and a multiple‑center‑of‑projection technique calibrates the geometry for perspective‑correct rendering. The projection technique delivers accurate vertical perspective and parallax for arbitrary viewer positions, as shown with interactive raster graphics and tracked viewer metrics, and it extends to photographed light fields with full horizontal and vertical parallax, while the display achieves good visual accommodation and supports color imagery.

Abstract

We describe a set of rendering techniques for an autostereoscopic light field display able to present interactive 3D graphics to multiple simultaneous viewers 360 degrees around the display. The display consists of a high-speed video projector, a spinning mirror covered by a holographic diffuser, and FPGA circuitry to decode specially rendered DVI video signals. The display uses a standard programmable graphics card to render over 5,000 images per second of interactive 3D graphics, projecting 360-degree views with 1.25 degree separation up to 20 updates per second. We describe the system's projection geometry and its calibration process, and we present a multiple-center-of-projection rendering technique for creating perspective-correct images from arbitrary viewpoints around the display. Our projection technique allows correct vertical perspective and parallax to be rendered for any height and distance when these parameters are known, and we demonstrate this effect with interactive raster graphics using a tracking system to measure the viewer's height and distance. We further apply our projection technique to the display of photographed light fields with accurate horizontal and vertical parallax. We conclude with a discussion of the display's visual accommodation performance and discuss techniques for displaying color imagery.

References

26