2018 · 24 citations · 22 references
ComputingComputer Science3D ModelingComputer VisionRobot VisionAction RecognitionAction RepresentationDeep LearningRepresentation LearningHuman ActionHuman Pose EstimationLie Group ActionsLie Group RepresentationsNon-euclidean TransformationsPose-based Action RecognitionSkeleton-based Action Recognition
This paper addresses the problem of human action recognition from sequences of 3D skeleton data. For this purpose, we combine a deep learning network with geometric features extracted from data lie on a non-Euclidean space, which have been recently shown to be very effective to capture the geometric structure of the human pose. In particular, our approach claims to incorporate the intrinsic nature of the data characterized by Lie Group into deep neural networks and to learn more adequate geometric features for 3D action recognition problem. First, geometric features are extracted from 3D joints of skeleton sequences using the Lie group representation. Then, the network model is built from stacked units of 1-dimensional CNN across the temporal domain. Finally, CNN-features are then used to train an LSTM layer to model dependencies in the temporal domain, and to perform the action recognition. The experimental evaluation is performed on three public datasets containing various challenges: UT-Kinect, Florence 3D-Action and MSR-Action 3D. Results reveal that our approach achieves most of the state-of-the-art performance.
22
Convolutional, Long Short-Term Memory, fully connected Deep Neural Networks
Tara N. Sainath, Oriol Vinyals, Andrew Senior et al. · 2015 · 1.6K citations
Mining actionlet ensemble for action recognition with depth cameras
Jiang Wang, Zicheng Liu, Ying Wu et al. · 2012 · 1.6K citations · Full text