Radar-Based Human Activity Recognition Using Hybrid Neural Network Model With Multidomain Fusion

Abstract

This article concerns the issue of how to combine the multidomainradar information, including range–Doppler, time–Doppler, and time–range, for human activity recognition. Specifically, to fully make use of radar information, instead of using a single-domain spectrum as inputs, a novel hybrid neural network model is developed for exploring multidomain fusion of radar information. In doing this, three kinds of 2-D domain spectra are used in a fashion of supplementing each other with a hybrid framework that combines three models: 1-D convolution neural network, recurrent neural network, and 2-D convolution network. It is advantageous to use such a hybrid model to capture much rich features through multidomain feature fusion, so as to improve the accuracy of human activity recognition effectively. Experimental results validate the proposed method.