User-Tailored Hand Gesture Recognition System for Wearable Prosthesis and Armband Based on Surface Electromyogram

Abstract

Surface electromyogram (sEMG) based hand gesture recognition for prosthesis or armband is an important application of the human-machine interface. However, the measurement location of sensors greatly influences the hand gesture performance, especially with the inter-day or inter-subject validation protocols. Therefore, we acquired two-day hand gesture data of 41 subjects with a 256 (16×16) channel high-density sEMG electrode array. With the acquired data, we initially compared the support vector machine (SVM) and other four state-of-art classifiers under three validation protocols, i.e., intra-day, inter-day and inter-subject validation protocols. Then, we screened 14 feature optimization techniques, including 5 feature-projection methods and 9 feature-ranking approaches. To present the accuracy tendency with varying measure locations, we systematically explored the 10-hand gesture performance using data of 16 prosthesis measurement locations (PMLs) and 15 armband measurement locations (AMLs). As a result, the SVM classifier was suitable for the intra-day and inter-day validation protocols and the 2-dimensional convolutional neural network was selected for the inter-subject validation protocol. The mean accuracies of the hand gesture classification ranged from 95.68% to 99.12% (intra-day validation), from 68.41% to 88.02% (inter-day validation) and from 63.39% to 86.33% (inter-subject validation) for the prosthesis application. In addition, for the armband application, the mean accuracies ranged from 96.25% to 97.43% (intra-day validation), from 67.44% to 75.83% (inter-day validation) and from 65.53% to 75.40% (inter-subject validation). The accuracy is greatly correlated with the measurement location, which is highly associated with the neuromuscular structures of human bodies. In summary, our work can serve as a factor-screening tool for users customizing their systems according to their physical conditions and requirements.