2019 · 135 citations · 41 references
ComputingComputer ScienceEducational TechnologyComputer VisionHuman BehaviorMachine LearningAction RecognitionStudent ModelingAction DetectionActivity RecognitionEarly Action RecognitionTeacher-student Learning
The goal of early action prediction is to recognize actions from partially observed videos with incomplete action executions, which is quite different from action recognition.Predicting early actions is very challenging since the partially observed videos do not contain enough action information for recognition.In this paper, we aim at improving early action prediction by proposing a novel teacherstudent learning framework.Our framework involves a teacher model for recognizing actions from full videos, a student model for predicting early actions from partial videos, and a teacher-student learning block for distilling progressive knowledge from teacher to student, crossing different tasks.Extensive experiments on three public action datasets show that the proposed progressive teacher-student learning framework can consistently improve performance of early action prediction model.We have also reported the state-of-the-art performances for early action prediction on all of these sets.
41
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Laurens van der Maaten, Geoffrey E. Hinton · Journal of Machine Learning Research · 2008 · 35.7K citations
Distilling the Knowledge in a Neural Network
Geoffrey E. Hinton, Oriol Vinyals · arXiv (Cornell University) · 2015 · 14K citations · Full text
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Christian Szegedy, Sergey Ioffe, Vincent Vanhoucke et al. · 2017 · 12.6K citations · Full text
Automatic differentiation in PyTorch
Adam Paszke, Sam Gross, Soumith Chintala et al. · 2017 · 11.1K citations