Back-Mirror

Abstract

Back-Mirror is a low-cost camera-based approach leveraging the usage of smartphone back surface by mirror reflection, and widening the interaction space on the back surface of phone. It consists of two main parts: a smartphone accessory with a small reflector located in front of the rear-facing camera, and a computer-vision algorithm for gesture recognition. Our approach tracks finger movement on the back surface with higher resolution than the previous methods, such as the recognition of long and short swipe. Furthermore, we created applications of Back-of-device, such as game, media player, photo gallery, and unlock mechanism, allowing users to experience the use of Back-Mirror Gestures in real life scenarios.