A Unified Remote Console Based on Augmented Reality in a Home Network Environment

Abstract

We introduce a unified remote console with an augmented reality (AR) interface to interact with appliances in a home network environment. Computer vision techniques are used in order to implement the AR interface. With the introduced remote console, users can control multiple appliances with a single remote console in intuitive ways such as gestures. It can also be used to manage multimedia files between appliances. For example, a user can move video clips from a camcorder to a TV set without any physical action of connecting appliances, if she uses the remote console. We used an open-standard middleware, UPnP, for our implementation.