Multi-finger gestural interaction with 3d volumetric displays

TLDR

Volumetric displays offer unique opportunities and challenges for 3‑D interaction and visualization, especially in highly interactive contexts. The study explores interactive direct manipulation of objects on a 3‑D volumetric display through the design and implementation of new techniques. The approach uses finger motion tracking to enable direct gestural manipulation of virtual objects around the display’s hemispheric enclosure, exploiting its 360° viewing volume and accurate depth perception. The techniques were demonstrated in a prototype 3‑D geometric model‑building application.

Abstract

Volumetric displays provide interesting opportunities and challenges for 3D interaction and visualization, particularly when used in a highly interactive manner. We explore this area through the design and implementation of techniques for interactive direct manipulation of objects with a 3D volumetric display. Motion tracking of the user's fingers provides for direct gestural interaction with the virtual objects, through manipulations on and around the display's hemispheric enclosure. Our techniques leverage the unique features of volumetric displays, including a 360° viewing volume that enables manipulation from any viewpoint around the display, as well as natural and accurate perception of true depth information in the displayed 3D scene. We demonstrate our techniques within a prototype 3D geometric model building application.