2020 · 15 citations · 18 references
ComputingComputer ScienceAutism Spectrum DisordersComputer VisionVisual AttentionAction RecognitionAttention NetworksDeep LearningObject DetectionScene UnderstandingVideo AnalysisActivity RecognitionConvolutional Neural Network DetectionFine-grained Action RecognitionFine-grained RecognitionFine-grained Visual RecognitionSpatial Attention NetworksSpatial Information ExtractionVideo Classification
Video-based Autism Spectrum Disorder (ASD) detection is a challenge to most video classification networks due to the high degree of similarity between categories. Bilinear pooling is a second-order method, which is widely used in fine-grained visual recognition. However, the average summation in bilinear pooling limits its ability to perceive spatial information, which is detrimental to fine-grained visual recognition. In this paper, we propose spatial attentional bilinear pooling to enhance its spatial information extraction without significantly increasing the parameters. Further, we propose a fine-grained action recognition network named SA-B3D with LSTM model for video-based ASD detection. The proposed model can focus on more discriminative regions dynamically and effectively. Compared with state-of-the-art models, the proposed model achieves significant improvement on video-based ASD dataset.
18
Laurens van der Maaten, Geoffrey E. Hinton · Journal of Machine Learning Research · 2008 · 35.7K citations
Learning Spatiotemporal Features with 3D Convolutional Networks
Du Tran, Lubomir Bourdev, Rob Fergus et al. · 2015 · 9.7K citations
Catherine Lord, Susan Risi, Linda Lambrecht et al. · Journal of Autism and Developmental Disorders · 2000 · 7.6K citations
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Kelvin Xu, Jimmy Ba, Ryan Kiros et al. · arXiv (Cornell University) · 2015 · 7.5K citations · Full text