Sensors · 2021 · 22 citations · 22 references
ComputingComputer ScienceComputer VisionMachine LearningSensor FusionAction RecognitionActivity PatternsDeep LearningNeural NetworksPattern RecognitionRepresentation LearningActivity RecognitionConvolutional Neural NetworksDeep Learning FusionDeep Learning-based Data FusionDeep Learning-based FusionHeterogeneous Sensor FusionHuman Activity RecognitionLong Short-term Memory Networks
Studies on deep-learning-based behavioral pattern recognition have recently received considerable attention. However, if there are insufficient data and the activity to be identified is changed, a robust deep learning model cannot be created. This work contributes a generalized deep learning model that is robust to noise not dependent on input signals by extracting features through a deep learning model for each heterogeneous input signal that can maintain performance while minimizing preprocessing of the input signal. We propose a hybrid deep learning model that takes heterogeneous sensor data, an acceleration sensor, and an image as inputs. For accelerometer data, we use a convolutional neural network (CNN) and convolutional block attention module models (CBAM), and apply bidirectional long short-term memory and a residual neural network. The overall accuracy was 94.8% with a skeleton image and accelerometer data, and 93.1% with a skeleton image, coordinates, and accelerometer data after evaluating nine behaviors using the Berkeley Multimodal Human Action Database (MHAD). Furthermore, the accuracy of the investigation was revealed to be 93.4% with inverted images and 93.2% with white noise added to the accelerometer data. Testing with data that included inversion and noise data indicated that the suggested model was robust, with a performance deterioration of approximately 1%.
22
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Henry Friday Nweke, Mohammed Ali Al-Garadi, Uzoma Rita Alo · Expert Systems with Applications · 2018 · 903 citations