Mohammad Shoeybi

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Mohammad Shoeybi, Mostofa Patwary, Raul Puri et al. · arXiv (Cornell University) · 2019 · 826 citations · Full text

Computing, Computer Science, High-performance Computing +16

Deep Voice: Real-time Neural Text-to-Speech

Sercan Ö. Arık, Mike Chrzanowski, Adam Coates et al. · arXiv (Cornell University) · 2017 · 395 citations · Full text

Computing, Data Science, Feature Engineering +16

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

Shaden Smith, Mostofa Patwary, Brandon Norick et al. · arXiv (Cornell University) · 2022 · 299 citations · Full text

Computing, Computer Science, High-performance Computing +17

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Teven Le Scao, Daniel Hesslow, Roman Castagné et al. · arXiv (Cornell University) · 2022 · 286 citations · Full text

Computing, Computer Science, Artificial Intelligence +12

VILA: On Pre-training for Visual Language Models

Lin Ji, Hongxu Yin, Ping Wei et al. · 2024 · 172 citations

Computing, Computer Science, Computational Linguistics +11