Evaluation of user gestures in multi-touch interaction

Abstract

Natural User Interfaces are often described as familiar, evocative and intuitive, predictable, based on common skills. Though un-questionable in principle, such definitions don't provide the de-signer with effective means to design a natural interface or evalu-ate a design choice vs another. Two main issues in particular are open: (i) how do we evaluate a natural interface, is there a way to measure 'naturalness'; (ii) do natural user interfaces provide a concrete advantage in terms of efficiency, with respect to more tradi-tional interface paradigms? In this paper we discuss and compare observations of user behavior in the task of pair programming, performed at a traditional desktop versus a multi-touch table. We show how the adoption of a multi-touch user interface fosters a significant, observable and measurable, increase of nonverbal communication in general and of gestures in particular, that in turn appears related to the overall performance of the users in the task of algorithm understanding and debugging.