Proceedings of the AAAI Conference on Artificial Intelligence · 2023 · 40 citations · 52 references
ComputingComputer ScienceComputer VisionMachine LearningRobot LearningAction RecognitionAction RepresentationDeep LearningGraph-based LearningMotion AnalysisPattern RecognitionAction UnderstandingActivity RecognitionAdjacency MatricesDynamic Graph AnalysisDynamic Graph FeaturesGraph Convolutional NetworksMotion Representation LearningSkeleton-based Action Recognition
Most skeleton-based action recognition methods assume that the same type of action samples in the training set and the test set share similar motion patterns. However, action samples in real scenarios usually contain novel motion patterns which are not involved in the training set. As it is laborious to collect sufficient training samples to enumerate various types of novel motion patterns, this paper presents a practical skeleton-based action recognition task where the training set contains common motion patterns of action samples and the test set contains action samples that suffer from novel motion patterns. For this task, we present a Mask Graph Convolutional Network (Mask-GCN) to focus on learning action-specific skeleton joints that mainly convey action information meanwhile masking action-agnostic skeleton joints that convey rare action information and suffer more from novel motion patterns. Specifically, we design a policy network to learn layer-wise body masks to construct masked adjacency matrices, which guide a GCN-based backbone to learn stable yet informative action features from dynamic graph structure. Extensive experiments on our newly collected dataset verify that Mask-GCN outperforms most GCN-based methods when testing with various novel motion patterns.
52
Categorical Reparameterization with Gumbel-Softmax
Eric Jang, Shixiang Gu, Ben Poole · arXiv (Cornell University) · 2016 · 3.2K citations · Full text
NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysis
Amir Shahroudy, Jun Liu, Tian-Tsong Ng et al. · 2016 · 2.9K citations
Two-Stream Adaptive Graph Convolutional Networks for Skeleton-Based Action Recognition
Lei Shi, Yifan Zhang, Jian Cheng et al. · 2019 · 2K citations