2023 · 338 citations · 26 references
ComputingComputer ScienceComputational LinguisticsCorpus-based Translation StudiesNatural Language ProcessingLanguage ModelingMachine TranslationMulti-task LearningMultilingual Natural Language ProcessingMultilingual ProcessingMultilingualismCross-lingual TransferLanguage Model Fine-tuningLanguage Model PretrainingLarge Language ModelsMulti-task Learning For Natural Language ProcessingMultilingual Machine TranslationPretrainingZero-shot Language Modeling
Niklas Muennighoff, Thomas Wang, Lintang Sutawika, Adam Roberts, Stella Biderman, Teven Le Scao, M Saiful Bari, Sheng Shen, Zheng Xin Yong, Hailey Schoelkopf, Xiangru Tang, Dragomir Radev, Alham Fikri Aji, Khalid Almubarak, Samuel Albanie, Zaid Alyafeai, Albert Webson, Edward Raff, Colin Raffel. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2023.
26
Binary codes capable of correcting deletions, insertions and reversals
V.I. Levenshtein · Soviet physics. Doklady · 1965 · 10.4K citations
LoRA: Low-Rank Adaptation of Large Language Models
J. Edward Hu, Yelong Shen, Phillip Wallis et al. · arXiv (Cornell University) · 2021 · 2.5K citations · Full text
Cross-lingual Language Model Pretraining
Guillaume Lample, Alexis Conneau · arXiv (Cornell University) · 2019 · 1.6K citations · Full text
mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer
Linting Xue, Noah Constant, Adam P. Roberts et al. · 2021 · 1.6K citations · Full text