Game-based human computer interaction using gesture recognition for rehabilitation

Abstract

This paper introduces a human computer interaction system by using hand gesture recognition to apply into game-based rehabilitation application. The basic concept of this project is to assist patient to carry out rehabilitation with hand gesture recognition, meanwhile therapist is able to follow recovery progress of patient through results. In this manner, a rehabilitation system created aimed to increase efficacy in patient treatment with interactive game. The system is applied in real time application to contribute as a function of a virtual mouse. Approach proposed including hand region segmentation, hand palm partition and finger counting. Computer mouse is configured to move according to the location of hand palm region, and perform function of ordinary mouse according to number of fingers detected. In the analysis, experiments is carried out to show how this system collaborate with the simple rehabilitation game in computer. Experiment evaluation as shown has successfully demonstrate the effectiveness and robustness in performing the mouse function and feasible to be implemented into rehabilitation games.