Concepedia

Samyam Rajbhandari

SR

Statistics

Publications

28

Citations

3.3K

H-Index

21

Active since

2012

Affiliations

Microsoft Research (United Kingdom)(Current)

Microsoft (United States)

The Ohio State University

Pacific Northwest National Laboratory

Environmental Molecular Sciences Laboratory

Samyam Rajbhandari is an author at Microsoft Research (United Kingdom) specializing in computer science, computing, and machine learning.

Publications per year

2012–2024

28

Publications

28

ZeRO: Memory optimizations Toward Training Trillion Parameter Models

Samyam Rajbhandari, Jeff Rasley, Olatunji Ruwase et al. · 2020 · 741 citations

Computing, Computer Engineering, Computer Science +16

Jeff Rasley, Samyam Rajbhandari, Olatunji Ruwase et al. · 2020 · 709 citations

Computing, Computer Science, High-performance Computing +17

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

Shaden Smith, Mostofa Patwary, Brandon Norick et al. · arXiv (Cornell University) · 2022 · 299 citations · Full text

Computing, Computer Science, High-performance Computing +17

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Teven Le Scao, Daniel Hesslow, Roman Castagné et al. · arXiv (Cornell University) · 2022 · 286 citations · Full text

Computing, Computer Science, Artificial Intelligence +12

DeepSpeed- Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale

Reza Yazdani Aminabadi, Samyam Rajbhandari, Ammar Ahmad Awan et al. · 2022 · 225 citations

Computing, Computer Engineering, Computer Science +17

1–5 of 28