Neural Networks · 2023 · 16 citations · 44 references
EducationEducational TechnologyKnowledge RepresentationLifelong LearningMachine LearningContinual LearningLearning SystemsLifelong Learning SystemsPersonalized Learning SystemsTransfer LearningTransfer Of LearningDomain-incremental Learning
44
Distilling the Knowledge in a Neural Network
Geoffrey E. Hinton, Oriol Vinyals · arXiv (Cornell University) · 2015 · 14K citations · Full text
Proceedings of the 24th international conference on Machine learning
2007 · 11.7K citations
Rich Caruana · Machine Learning · 1997 · 6.3K citations · Full text
Proceedings of the 21st International Conference on Neural Information Processing Systems
Daphne Koller, Dale Schuurmans, Yoshua Bengio et al. · 2008 · 4.5K citations
Knowledge Distillation: A Survey
Jianping Gou, Baosheng Yu, Stephen J. Maybank et al. · International Journal of Computer Vision · 2021 · 3.5K citations · Full text
Computing, Chemical Engineering, Knowledge Representation +2