arXiv (Cornell University) · 2017 · 12 citations · 3 references
ComputingComputer EngineeringComputer ScienceMachine LearningMobile ComputingNeural EngineeringData CompressionDeep LearningLossy Data CompressionNeural ModelingNeural NetworksVariational InferenceCompressionCompression TechniquesDropoutModel CompressionNeural Data CompressionState-of-the-art ReviewVariational DropoutWeight Sharing
Compression of Neural Networks (NN) has become a highly studied topic in recent years. The main reason for this is the demand for industrial scale usage of NNs such as deploying them on mobile devices, storing them efficiently, transmitting them via band-limited channels and most importantly doing inference at scale. In this work, we propose to join the Soft-Weight Sharing and Variational Dropout approaches that show strong results to define a new state-of-the-art in terms of model compression.
3
Learning Structured Sparsity in Deep Neural Networks
Wei Wen, Chunpeng Wu, Yandan Wang et al. · arXiv (Cornell University) · 2016 · 468 citations · Full text
Bayesian Compression for Deep Learning
Christos Louizos, Karen Ullrich, Max Welling · arXiv (Cornell University) · 2017 · 350 citations · Full text