Marker tracking and HMD calibration for a video-based augmented reality conferencing system

TLDR

The paper presents an augmented reality conferencing system that overlays virtual images onto the real world and proposes a fiducial marker tracking and HMD calibration method to enable this. The system uses computer vision‑based marker tracking and optical see‑through HMD calibration to precisely register virtual monitors and whiteboards, allowing collaborators to freely position and interact with virtual objects.

Abstract

We describe an augmented reality conferencing system which uses the overlay of virtual images on the real world. Remote collaborators are represented on virtual monitors which can be freely positioned about a user in space. Users can collaboratively view and interact with virtual objects using a shared virtual whiteboard. This is possible through precise virtual image registration using fast and accurate computer vision techniques and head mounted display (HMD) calibration. We propose a method for tracking fiducial markers and a calibration method for optical see-through HMD based on the marker tracking.