Comparing motor-cognitive strategies for spatial problem solving with tangible and multi-touch interfaces

Abstract

We present the results from a mixed methods comparison of a tangible and a multi-touch interface for a spatial problem solving task. We applied a modified version of a previous framework to code video of hand-based events. This enabled us to investigate motor-cognitive strategies as well as traditional performance and preference constructs. Sixteen adult participants completed jigsaw puzzles using both interfaces. Our results suggest that the 3D manipulation space, eyes-free tactile feedback, and the offline workspace afforded by the tangible interface enabled more efficient and effective motor-cognitive strategies. We discuss the implications of these findings for interface design; including suggestions for spatial and visual structures that may support epistemic strategies, and hybrid interfaces where tangible handles may be used as structural anchors as well as controls and representational objects.