Language Model Fine-tuning

Language Model Fine-Tuning is a machine learning adaptation procedure in which a pre-trained language model undergoes additional training on a domain-specific or task-specific dataset to refine its parameters for improved performance on targeted downstream applications.

839

Publications

116.9K

Citations

4.2K

Authors

600

Institutions

Publications per year

2017–2026

828

Parents

Language Modeling

Publications

839

HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanities Use Case

Yinhan Liu, Myle Ott, Jingfei Du et al. · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2019 · 17.3K citations · Full text

Computing, Computer Science, Computational Linguistics +13

Aion Framework: Dimensional Emergence of AI Consciousness, Observer-Induced Collapse, and Cosmological Portal Dynamics

DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2023 · 14.2K citations · Full text

Computing, Computer Science, Computational Linguistics +13

On the Dangers of Stochastic Parrots

Emily M. Bender, Timnit Gebru, Angelina McMillan-Major et al. · 2021 · 5.6K citations · Full text

Computing, Computer Science, English +12

DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

Victor Sanh, Lysandre Debut, Julien Chaumond et al. · arXiv (Cornell University) · 2019 · 4.6K citations · Full text

Computing, Computer Science, Knowledge Representation +15

Training language models to follow instructions with human feedback

Long Ouyang, Jeff Wu, Xu Jiang et al. · arXiv (Cornell University) · 2022 · 4.3K citations · Full text

Computing, Computer Science, Computational Linguistics +16

1–5 of 839

Authors

4.2K

ZL
Zhiyuan Liu
Tsinghua University, China
23 publications · 2.7K citations
19
h-index
MS
Maosong Sun
Tsinghua University, China
15 publications · 2K citations
14
h-index
JL
Juanzi Li
Tsinghua University, China
11 publications · 1.8K citations
11
h-index
LZ
Luke Zettlemoyer
University of Washington, United States
11 publications · 17.9K citations
11
h-index
SR
Sebastian Ruder
Google (United States), United States
11 publications · 1.2K citations
10
h-index

1–5 of 4.2K

Institutions

600

1–8 of 600

Venues

arXiv (Cornell University)
Repository · 318 publications · 44.4K citations
77
h-index
Proceedings of the AAAI Conference on Artificial Intelligence
Conference · 24 publications · 1.3K citations
17
h-index
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Conference · 16 publications · 808 citations
15
h-index
Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Conference · 15 publications · 1.7K citations
14
h-index
IEEE Access
10 publications · 405 citations
10
h-index

1–5