Duet

TLDR

Smart devices are redefining mobile interaction, shifting from single‑device use to collaborative multi‑device experiences. The paper introduces Duet, an interactive system that explores phone–watch interaction design. Duet coordinates phone and watch motion, touch, visual and tactile output based on spatial configuration, and its gestures and sensing techniques were evaluated for accuracy and usability. Duet turns the watch into an active element, enhancing phone tasks and enabling new multi‑device gestures, with technical evaluation confirming gesture accuracy and a subjective study offering design insights.

Abstract

The emergence of smart devices (e.g., smart watches and smart eyewear) is redefining mobile interaction from the solo performance of a smart phone, to a symphony of multiple devices. In this paper, we present Duet -- an interactive system that explores a design space of interactions between a smart phone and a smart watch. Based on the devices' spatial configurations, Duet coordinates their motion and touch input, and extends their visual and tactile output to one another. This transforms the watch into an active element that enhances a wide range of phone-based interactive tasks, and enables a new class of multi-device gestures and sensing techniques. A technical evaluation shows the accuracy of these gestures and sensing techniques, and a subjective study on Duet provides insights, observations, and guidance for future work.