Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · 2023 · 22 citations · 46 references
ComputingComputer ScienceFeature EngineeringMachine LearningSensor FusionAction RecognitionPattern RecognitionRepresentation LearningSelf-supervised LearningWearable Health TechnologiesEncoder-decoder ArchitecturesHuman Activity RecognitionSelf-supervised Representation LearningSpatial MaskingWearable Devices
The widespread adoption of wearable devices has led to a surge in the development of multi-device wearable human activity recognition (WHAR) systems. Nevertheless, the performance of traditional supervised learning-based methods to WHAR is limited by the challenge of collecting ample annotated wearable data. To overcome this limitation, self-supervised learning (SSL) has emerged as a promising solution by first training a competent feature extractor on a substantial quantity of unlabeled data, followed by refining a minimal classifier with a small amount of labeled data. Despite the promise of SSL in WHAR, the majority of studies have not considered missing device scenarios in multi-device WHAR. To bridge this gap, we propose a multi-device SSL WHAR method termed Spatial-Temporal Masked Autoencoder (STMAE). STMAE captures discriminative activity representations by utilizing the asymmetrical encoder-decoder structure and two-stage spatial-temporal masking strategy, which can exploit the spatial-temporal correlations in multi-device data to improve the performance of SSL WHAR, especially on missing device scenarios. Experiments on four real-world datasets demonstrate the efficacy of STMAE in various practical scenarios.
46
Introducing a New Benchmarked Dataset for Activity Monitoring
Attila Reiss, Didier Stricker · 2012 · 1.3K citations
Collecting complex activity datasets in highly rich networked sensor environments
Daniel Roggen, Alberto Calatroni, Mirco Rossi et al. · 2010 · 755 citations · Full text