Dehao Chen

LaMDA: Language Models for Dialog Applications

Romal Thoppilan, Daniel De Freitas, Jamie Hall et al. · arXiv (Cornell University) · 2022 · 704 citations · Full text

Llm Fine-tuning, Engineering, Machine Learning +17

GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding

Dmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu et al. · arXiv (Cornell University) · 2020 · 348 citations · Full text

Engineering, Machine Learning, Computer Architecture +23

GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism

Yanping Huang, Youlong Cheng, Ankur Bapna et al. · arXiv (Cornell University) · 2018 · 236 citations · Full text

Multiple Accelerators, Convolutional Neural Network, Engineering +16

Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling

Jonathan Shen, Patrick Nguyen, Yonghui Wu et al. · arXiv (Cornell University) · 2019 · 183 citations · Full text

Engineering, Machine Learning, Tensorflow Framework +16

MLPerf Training Benchmark

Peter Mattson, Christine Cheng, Cody Coleman et al. · arXiv (Cornell University) · 2019 · 171 citations · Full text

Engineering, Machine Learning, Machine Learning Tool +18