2020 · 10 citations · 28 references
ComputingVision ScienceComputer VisionMachine VisionVisual AttentionAction RecognitionAction RepresentationDeep LearningObject DetectionShort-term MemoryVideo AnalysisAction DetectionActivity RecognitionAttention PoolingAttention-based Action RecognitionSpatio-temporal RepresentationSpatiotemporal Feature ExtractionSpatiotemporal Feature LearningVideo Action Recognition
Video analysis is gaining importance in the recent past due to its usefulness in a wide variety of applications. The efficiency of a video analytics engine primarily depends on its ability to extract the spatio-temporal features, which has enough discriminative. Inspired by the way the human visual system operates, we propose a hierarchical architecture to capture the spatio-temporal information from a given input video at different time scales. The proposed architecture has a 3D Inception module followed by two layers of modified Convolutional Long Short Term Memory (ConvLSTM) as the fundamental unit. At each level, we consolidate the LSTM cell and hidden states to the next level by using an visual attention-based pooling approach. The proposed network is used for video action detection and localization application that is the foundational element for video analysis. UCF101 and AVA datasets are used to show that the recognition accuracy achieved by the proposed algorithm advances the state-of-the-art in spatio-temporal action detection and localization application.
28
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
Xingjian Shi, Zhourong Chen, Hao Wang et al. · arXiv (Cornell University) · 2015 · 6.6K citations · Full text
SlowFast Networks for Video Recognition
Christoph Feichtenhofer, Haoqi Fan, Jitendra Malik et al. · 2019 · 3.6K citations