Compressing medical deep neural network models for edge devices using knowledge distillation

Distilling the Knowledge in a Neural Network

Geoffrey E. Hinton, Oriol Vinyals · arXiv (Cornell University) · 2015 · 13.9K citations · Full text

Artificial Intelligence, Engineering, Machine Learning +19

Knowledge Distillation: A Survey

Jianping Gou, Baosheng Yu, Stephen J. Maybank et al. · International Journal of Computer Vision · 2021 · 3.1K citations · Full text

Engineering, Knowledge Distillation, Automated Reasoning +9

Using AUC and accuracy in evaluating learning algorithms

Jin Huang, Charles X. Ling · IEEE Transactions on Knowledge and Data Engineering · 2005 · 2.1K citations

Artificial Intelligence, Engineering, Machine Learning +20

FitNets: Hints for Thin Deep Nets

Adriana Romero, Nicolas Ballas, Samira Ebrahimi Kahou et al. · arXiv (Cornell University) · 2014 · 2K citations · Full text

Artificial Intelligence, Convolutional Neural Network, Thin Deep Nets +14

BinaryConnect: Training Deep Neural Networks with binary weights during propagations

Matthieu Courbariaux, Yoshua Bengio, Jean‐Pierre David · PolyPublie (École Polytechnique de Montréal) · 2015 · 1.8K citations · Full text

Artificial Intelligence, Convolutional Neural Network, Deep Neural Networks +12