CLIMATEBERT: A Pretrained Language Model for Climate-Related Text

HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanities Use Case

Yinhan Liu, Myle Ott, Naman Goyal et al. · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2019 · 17.1K citations · Full text

BioBERT: a pre-trained biomedical language representation model for biomedical text mining

Jinhyuk Lee, Wonjin Yoon, Sungdong Kim et al. · Bioinformatics · 2019 · 6.5K citations · Full text

A unified architecture for natural language processing

Ronan Collobert, Jason Weston · 2008 · 5.2K citations

Engineering, Machine Learning, Cross-lingual Representation +19

On the Dangers of Stochastic Parrots

Emily M. Bender, Timnit Gebru, Angelina McMillan-Major et al. · 2021 · 4.7K citations · Full text

Engineering, Multilingual Pretraining, Large Language Model +24

DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

Victor Sanh, Lysandre Debut, Julien Chaumond et al. · arXiv (Cornell University) · 2019 · 4.6K citations · Full text

Natural Language Processing, Large Language Models, Large Ai Model +14