Many-to-One Gesture-to-Command Flexible Mapping Approach for Smart Teaching Interface Interaction

Abstract

Mapping between gestures and semantics is inherently challenging, especially in the aspect of defining meaningful gesture semantics that are easy to understand and remember. To address this challenge, we put forward an intent-driven approach in this paper, which is based on users' interaction intent. We implemented a many-to-one flexible mapping between multiple gestures and one semantic object. We also designed and evaluated a domain-specific gestural input technique for classroom use by considering the intent of the user. The main contributions of this work consist of: (1) a mapping between multiple gestures and one semantics and (2) an intelligent and natural interacting interface model for a three-dimensional (3D) user interfaces (UIs). The proposed algorithm is evaluated with five frequently used gestures and applied to the UIs system. The experimental results demonstrate that the gesture-based algorithm performs well and can substantially reduce the memory loads of the user.