Evaluation of a Hybrid of Hand Gesture and Controller Inputs in Virtual Reality

Abstract

Controller and hand gesture recognition are both common input mechanisms in immersive environments. We evaluate the effect of combining them as a hybrid input to perform game-like tasks. To explore the possible design space, three tests were conducted sequentially. First, a design study was conducted to investigate which of the tasks were most likely to be performed with hybrid inputs. Next, we implemented the four highest-ranked tasks and invited 22 participants to perform these tasks with different input combinations. From examining execution times and reviewing feedback from participants, we provide observations and discussions concerning the usage of a hybrid input. A follow-up experiment was designed to refine these observations. The results indicate that task execution using hybrid inputs is as efficient as bimanual controllers when assigning actions to the appropriate input. Finally, a few guidelines are provided suggesting how to consider possible scenarios for this hybrid input.