Virtual object manipulation on a table-top AR environment

TLDR

In table‑top AR interfaces, precise tracking and registration are essential, especially for face‑to‑face collaboration where users must cooperate easily. The study aims to solve virtual object interaction and user tracking challenges in a table‑top AR interface. An accurate vision‑based tracking method and associated tangible user interface techniques enable natural manipulation of virtual objects and are demonstrated in prototype AR applications. The approach remains robust when users cover tracking markers, still providing camera viewpoint data and surpassing limitations of conventional computer vision systems.

Abstract

We address the problems of virtual object interaction and user tracking in a table-top augmented reality (AR) interface. In this setting there is a need for very accurate tracking and registration techniques and an intuitive and useful interface. This is especially true in AR interfaces for supporting face to face collaboration where users need to be able to easily cooperate with each other. We describe an accurate vision-based tracking method for table-top AR environments and tangible user interface (TUI) techniques based on this method that allow users to manipulate virtual objects in a natural and intuitive manner. Our approach is robust, allowing users to cover some of the tracking markers while still returning camera viewpoint information, overcoming one of the limitations of traditional computer vision based systems. After describing this technique we describe its use in prototype AR applications.