Neural Network Distiller

Neta Zmora, Guy Jacob, Gal Novik

Zenodo (CERN European Organization for Nuclear Research) · 2018 · 40 citations · 0 references

DOIFull text

Open access

Concepts

Abstract

PyTorch 0.4 support An implementation of Baidu's RNN pruning paper from ICLR 2017 Narang, Sharan & Diamos, Gregory & Sengupta, Shubho & Elsen, Erich. (2017). <i>Exploring Sparsity in Recurrent Neural Networks</i>. (https://arxiv.org/abs/1704.05119) Add a word language model pruning example using AGP and Baidu RNN pruning Quantization aware training (4-bit quantization) New models: pre-activation ResNet for ImageNet and CIFAR, and AlexNet with batch-norm New quantization documentation content