Leandro von Werra

StarCoder: may the source be with you!

Raymond Li, Loubna Ben Allal, Yangtian Zi et al. · arXiv (Cornell University) · 2023 · 192 citations · Full text

Computing, Computer Science, Natural Language Processing +5

The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset

Hugo Laurençon, Lucile Saulnier, Thomas J. Wang et al. · arXiv (Cornell University) · 2023 · 65 citations · Full text

Computing, Computer Science, Data Science +17

Zephyr: Direct Distillation of LM Alignment

Lewis Tunstall, Edward Beeching, Nathan Lambert et al. · arXiv (Cornell University) · 2023 · 54 citations · Full text

Computing, Computer Science, Computational Linguistics +13

SantaCoder: don't reach for the stars!

Loubna Ben Allal, Raymond Li, Denis Kocetkov et al. · arXiv (Cornell University) · 2023 · 51 citations · Full text

Computing, Computer Science, Natural Language Processing +9

The Stack: 3 TB of permissively licensed source code

Denis Kocetkov, Raymond Li, Loubna Ben Allal et al. · arXiv (Cornell University) · 2022 · 38 citations · Full text

Computing, Computer Science, Artificial Intelligence +8