Iulia Turc

Well-Read Students Learn Better: On the Importance of Pre-training Compact Models

Iulia Turc, Ming‐Wei Chang, Kenton Lee et al. · arXiv (Cornell University) · 2019 · 428 citations · Full text

Llm Fine-tuning, Engineering, Machine Learning +28

Well-Read Students Learn Better: The Impact of Student Initialization on Knowledge Distillation

Iulia Turc, Ming‐Wei Chang, Kenton Lee et al. · arXiv (Cornell University) · 2019 · 138 citations · Full text

Knowledge Distillation, Student Learning, Reading Comprehension +5

<scp>Canine</scp>: Pre-training an Efficient Tokenization-Free Encoder for Language Representation

Jonathan H. Clark, Dan Garrette, Iulia Turc et al. · Transactions of the Association for Computational Linguistics · 2022 · 115 citations · Full text

Llm Fine-tuning, Engineering, Machine Learning +20

Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understanding

Kenton Lee, Mandar Joshi, Iulia Turc et al. · arXiv (Cornell University) · 2022 · 45 citations · Full text

Natural Language Processing, Visually-situated Language, Multimodal Llm +15

Revisiting the Primacy of English in Zero-shot Cross-lingual Transfer

Iulia Turc, Kenton Lee, Jacob Eisenstein et al. · arXiv (Cornell University) · 2021 · 37 citations · Full text

Popular Zero-shot Benchmarks, Llm Fine-tuning, Engineering +19