Gestural and audio metaphors as a means of control for mobile devices

TLDR

Gesture and audio controls enable mobile music players to be used without visual attention while moving. The study explores gesture and non‑speech audio as alternative interfaces for mobile music players. The authors evaluated the interface through a controlled usability experiment against a standard design and a video‑based field study. Both studies revealed significant usability gains for the gesture/audio interface compared to a visual/pen design, and the authors discuss the convergences and divergences of the findings.

Abstract

This paper discusses the use of gesture and non-speech audio as ways to improve the user interface of a mobile music player. Their key advantages mean that users could use a player without having to look at its controls when on the move. Two very different evaluations of the player took place: one based on a standard usability experiment (comparing the new player to a standard design) and the other a video analysis of the player in use. Both of these showed significant usability improvements for the gesture/audio-based interface over a standard visual/pen-based display. The similarities and differences in the results produced by the two studies are discussed