IEEE Transactions on Cybernetics · 2017 · 79 citations · 46 references
ComputingComputer ScienceComputer VisionFeature EngineeringRobot VisionAction RecognitionMotion AnalysisMotion EstimationPose EstimationBody Pose EstimationConvolutional Neural NetworksFeature PoolingFeature Pooling ModelsJoint DetectionSkeleton-based Action RecognitionSpatiotemporal Feature LearningTemporal Dimensions
3-D convolutional neural networks (3-D CNNs) have been established as a powerful tool to simultaneously learn features from both spatial and temporal dimensions, which is suitable to be applied to video-based action recognition. In this paper, we propose not to directly use the activations of fully connected layers of a 3-D CNN as the video feature, but to use selective convolutional layer activations to form a discriminative descriptor for video. It pools the feature on the convolutional layers under the guidance of body joint positions. Two schemes of mapping body joints into convolutional feature maps for pooling are discussed. The body joint positions can be obtained from any off-the-shelf skeleton estimation algorithm. The helpfulness of the body joint guided feature pooling with inaccurate skeleton estimation is systematically evaluated. To make it end-to-end and do not rely on any sophisticated body joint detection algorithm, we further propose a two-stream bilinear model which can learn the guidance from the body joints and capture the spatio-temporal features simultaneously. In this model, the body joint guided feature pooling is conveniently formulated as a bilinear product operation. Experimental results on three real-world datasets demonstrate the effectiveness of body joint guided pooling which achieves promising performance.
46
Histograms of Oriented Gradients for Human Detection
Navneet Dalal, Bill Triggs · 2005 · 31.9K citations · Full text
Yangqing Jia, Evan Shelhamer, Jeff Donahue et al. · 2014 · 11.2K citations
Learning Spatiotemporal Features with 3D Convolutional Networks
Du Tran, Lubomir Bourdev, Rob Fergus et al. · 2015 · 9.7K citations
LIBLINEAR: A Library for Large Linear Classification
Rong-En Fan, Kai‐Wei Chang, Cho‐Jui Hsieh et al. · 2008 · 6.6K citations