A Methodological Framework to Assess the Accuracy of Virtual Reality Hand-Tracking Systems: A case study with the Oculus Quest 2

Abstract

Abstract Optical marker-less hand-tracking systems incorporated into virtual reality (VR) headsets are transforming the ability to assess motor skills, including hand movements, in VR. This promises to have far-reaching implications for the increased applicability of VR across scientific, industrial and clinical settings. However, so far, there is little data regarding the accuracy, delay and overall performance of these types of hand-tracking systems. Here we present a novel methodological framework which can be easily applied to measure these systems’ absolute positional error, temporal delay and finger joint-angle accuracy. We used this framework to evaluate the Meta Quest 2 hand-tracking system. Our results showed an average fingertip positional error of 1.1 cm , an average finger joint angle error of 9.6 o and an average temporal delay of 38.0 ms . Finally, a novel approach was developed to correct for these positional errors based on a lens distortion model. This methodological framework provides a powerful tool to ensure the reliability and validity of data originating from VR-based, marker-less hand-tracking systems.