2023 · 106 citations · 70 references
ComputingComputer ScienceComputational LinguisticsNatural Language ProcessingLanguage ModelingLanguage ModelsMachine TranslationMultilingual Natural Language ProcessingNatural Language GenerationWord EmbeddingsCross-lingual Language ModelingLanguage Model PretrainingLarge Language ModelsLarge-scale Natural Language ProcessingNeural Language ModelsSentence Modeling
Daoguang Zan, Bei Chen, Fengji Zhang, Dianjie Lu, Bingchao Wu, Bei Guan, Wang Yongji, Jian-Guang Lou. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2023.
70
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2023 · 76.3K citations · Full text
Decoupled Weight Decay Regularization
Ilya Loshchilov, Frank Hutter · arXiv (Cornell University) · 2017 · 9.1K citations · Full text
ROUGE: A Package for Automatic Evaluation of Summaries
Chin-Yew Lin · 2004 · 8.3K citations