Concepedia

Mohammad Shoeybi

MS

Statistics

Publications

33

Citations

2.8K

H-Index

20

Active since

2005

Affiliations

Stanford University(Current)

Nvidia (United Kingdom)

Nvidia (United States)

Carleton University

Uppsala University

Mohammad Shoeybi is an author at Stanford University specializing in engineering, natural language processing, and deep learning.

Top concepts

EngineeringNatural Language ProcessingMachine LearningComputer ScienceMachine TranslationComputational LinguisticsDeep LearningData ScienceLanguageLinguistics

Publications per year

2005–2024

33

Publications

33

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Mohammad Shoeybi, Mostofa Patwary, Raul Puri et al. · arXiv (Cornell University) · 2019 · 819 citations · Full text

Llm Fine-tuning, Engineering, Machine Learning +22

Deep Voice: Real-time Neural Text-to-Speech

Sercan Ö. Arık, Mike Chrzanowski, Adam Coates et al. · arXiv (Cornell University) · 2017 · 395 citations · Full text

Engineering, Machine Learning, Deep Voice +17

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

Shaden Smith, Mostofa Patwary, Brandon Norick et al. · arXiv (Cornell University) · 2022 · 299 citations · Full text

Artificial Intelligence, Llm Fine-tuning, Megatron-turing Nlg 530B +21

On the Use of the Ffowcs Williams-Hawkings Equation to Predict Far-Field Jet Noise from Large-Eddy Simulations

Simon Mendez, Mohammad Shoeybi, Sanjiva K. Lele et al. · International Journal of Aeroacoustics · 2013 · 129 citations

Aeroacoustics, Engineering, Fluid Mechanics +16

VILA: On Pre-training for Visual Language Models

Lin Ji, Hongxu Yin, Ping Wei et al. · 2024 · 128 citations

1–5 of 33