Phu Mon Htut

Intermediate-Task Transfer Learning with Pretrained Language Models: When and Why Does It Work?

Yada Pruksachatkun, Jason Phang, Haokun Liu et al. · 2020 · 166 citations · Full text

Second Language Learning, Llm Fine-tuning, Engineering +23

BBQ: A hand-built bias benchmark for question answering

Alicia Parrish, Angelica Chen, Nikita Nangia et al. · Findings of the Association for Computational Linguistics: ACL 2022 · 2022 · 117 citations · Full text

Investigating BERT’s Knowledge of Language: Five Analysis Methods with NPIs

Alex Warstadt, Yu Cao, Ioana Grosu et al. · 2019 · 90 citations · Full text

Engineering, Alex Warstadt, Semantics +18

Generalized Inner Loop Meta-Learning

Edward Grefenstette, Brandon Amos, Denis Yarats et al. · arXiv (Cornell University) · 2019 · 88 citations · Full text

Artificial Intelligence, Model Optimization, Engineering +10

Do Attention Heads in BERT Track Syntactic Dependencies?

Phu Mon Htut, Jason Phang, Shikha Bordia et al. · arXiv (Cornell University) · 2019 · 88 citations · Full text

Syntactic Parsing, Specialist Attention Heads, Engineering +18