Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · 2022 · 44 citations · 30 references
EngineeringMachine LearningLarge Language ModelNatural Language ProcessingApplied LinguisticsSyntaxComputational LinguisticsLanguage EngineeringGrammarLanguage StudiesChaofan TaoMachine TranslationVolume 1Nlp TaskPre-trained ModelsModel CompressionLong PapersLinguisticsComputational Semantics
Chaofan Tao, Lu Hou, Wei Zhang, Lifeng Shang, Xin Jiang, Qun Liu, Ping Luo, Ngai Wong. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2022.
30
Distilling the Knowledge in a Neural Network
Geoffrey E. Hinton, Oriol Vinyals · arXiv (Cornell University) · 2015 · 13.9K citations · Full text
Momentum Contrast for Unsupervised Visual Representation Learning
Kaiming He, Haoqi Fan, Yuxin Wu et al. · 2020 · 11.6K citations
Convolutional Neural Network, Image Analysis, Machine Learning +14
Decoupled Weight Decay Regularization
Ilya Loshchilov, Frank Hutter · arXiv (Cornell University) · 2017 · 9K citations · Full text
Exploring the Limits of Transfer Learning with a Unified Text-to-Text\n Transformer
Colin Raffel, Noam Shazeer, Adam Roberts et al. · arXiv (Cornell University) · 2019 · 8.3K citations · Full text