Multifeature Fusion-Based Hand Gesture Sensing and Recognition System

Abstract

With the development of the radar sensing technology, hand gesture sensing and recognition has attracted much attention. This letter adopts a frequency-modulated continuous wave (FMCW) radar to achieve short-range hand gesture sensing and recognition. Specifically, the range, Doppler, and angle parameters of hand gestures are measured by fast Fourier transformation (FFT) and multiple signal classification (MUSIC) algorithm, respectively. The mixup (MP) algorithm combined with augmentation (AU) algorithm using a weight factor is applied to expand the hand gesture data. Then, a complementary multidimensional feature fusion network-based hand gesture recognition (CMFF-HGR) is designed to extract the features and achieve HGR. Finally, a series of experiments are carried out to verify the effectiveness of the proposed approach, and the results show that the recognition accuracy is higher than the existing alternatives with low computational complexity.