2020 · 60 citations · 12 references
ComputingTranslation StudiesCorpus-based Translation StudiesTranslation TheoryTranslator TrainingLanguage ModelingMachine TranslationMultilingual Natural Language ProcessingMultilingual ProcessingMultilingual Machine TranslationNeural Machine TranslationTransformer Language ModelsZero-shot Language ModelingZero-shot Machine Translation
We propose a novel adapter layer formalism for adapting multilingual models. They are more parameter-efficient than existing adapter layers while obtaining as good or better performance. The layers are specific to one language (as opposed to bilingual adapters) allowing to compose them and generalize to unseen language-pairs. In this zero-shot setting, they obtain a median improvement of +2.77 BLEU points over a strong 20-language multilingual Transformer baseline trained on TED talks.
12
fairseq: A Fast, Extensible Toolkit for Sequence Modeling
Myle Ott, Sergey Edunov, Alexei Baevski et al. · 2019 · 2.5K citations · Full text
Massively Multilingual Neural Machine Translation
Roee Aharoni, Melvin Johnson · 2019 · 415 citations · Full text