2018 · 22 citations · 10 references
ComputingComputer ScienceComputer VisionMachine LearningTime Series AnalysisAction RecognitionActivity PatternsAttention NetworksDeep LearningTemporal AttentionWearable Health TechnologiesActivitiesActivity RecognitionAttentionBenchmark DatasetsHuman Activity RecognitionTemporal Context
Deep Learning methods have become very attractive in the wider, wearables-based human activity recognition (HAR) research community. The majority of models are based on either convolutional or explicitly temporal models, or combinations of both. In this paper we introduce attention models into HAR research as a data driven approach for exploring relevant temporal context. Attention models learn a set of weights over input data, which we leverage to weight the temporal context being considered to model each sensor reading. We construct attention models for HAR by adding attention layers to a state-of-the-art deep learning HAR model (DeepConvLSTM) and evaluate our approach on benchmark datasets achieving significant increase in performance. Finally, we visualize the learned weights to better understand what constitutes relevant temporal context.
10
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Dropout: a simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky et al. · 2014 · 34.3K citations
Introducing a New Benchmarked Dataset for Activity Monitoring
Attila Reiss, Didier Stricker · 2012 · 1.3K citations
Convolutional Neural Networks for Human Activity Recognition using Mobile Sensors
Ming Zeng, Le T. Nguyen, Bo Yu et al. · 2014 · 855 citations · Full text