Deep Transfer Learning with Graph Neural Network for Sensor-Based Human Activity Recognition

Abstract

The sensor-based human activity recognition (HAR) in mobile application scenarios is often confronted with variation in sensing modalities and deficiencies in annotated samples. To address these two challenging problems, we devised a graph-inspired deep learning approach that uses data from human-body mounted wearable sensors. As a step toward a complete HAR solution, the proposed method was further used to build a deep transfer learning model. Specifically, we present a multi-layer residual structure involving graph convolutional neural network (ResGCNN) toward the sensor-based HAR tasks, namely the HAR-ResGCNN approach. Experimental results on the PAMAP2 and mHealth data sets demonstrate that our ResGCNN is effective at capturing the characteristics of actions with comparable results compared to other sensor-based HAR models (with an average accuracy of 98.18% and 99.07%, respectively). More importantly, the parameter-based transfer learning experiments using the ResGCNN model show excellent transferability and small sample learning ability, which is a promising solution in sensor-based HAR applications.