Toe Input Using a Mobile Projector and Kinect Sensor

Abstract

Due to the prevalence of cell phones many people view information on small handheld LCD screens. However, these mobile devices require the use of one hand, the user needs to keep a close watch on a small display, and they have to be retrieved from a pocket or a bag. To overcome these problems, we focus on wearable projection systems that enable hands-free viewing via large projected screens, eliminating the need to retrieve and hold devices. In this paper, we present a toe input system that can realize haptic interaction, direct manipulation, and floor projection using a wearable projection system with a large projection surface. It is composed of a mobile projector, Kinect depth camera, and a gyro sensor. It is attached to the user's chest and can detect when the users foot touches or rises from the floor. To evaluate the system we conducted experiments investigating object selection by foot motion.