Hand Tracking with Vibrotactile Feedback Enhanced Presence, Engagement, Usability, and Performance in a Virtual Reality Rhythm Game

Abstract

Recent hand tracking systems and wearable haptic devices have contributed to enhancing user experience in virtual environments. However, controllers are still prevalent in virtual reality (VR) games as a main interaction device. Also, haptic devices are rare and not widely accepted by users. In this article, we examined the effects of interaction methods and vibrotactile feedback on users’ sense of presence, engagement, usability, and task performance in a VR game. In our experiment, 36 participants wearing VR goggle played a rhythm game under three conditions: (1) VR controllers, (2) hand tracking without vibrotactile feedback, and (3) hand tracking with vibrotactile feedback at fingertips through the gloves we developed. Results showed that hand tracking improved presence, engagement, usability, and performance, compared to the VR controller. Furthermore, vibrotactile feedback enhanced presence and engagement even more clearly. Results are discussed with the components of VR user experience and practical design guidelines.