Ammar Ahmad Awan

DeepSpeed- Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale

Reza Yazdani Aminabadi, Samyam Rajbhandari, Ammar Ahmad Awan et al. · 2022 · 198 citations

Convolutional Neural Network, Engineering, Machine Learning +19

S-Caffe

Ammar Ahmad Awan, Khaled Hamidouche, Jahanzeb Maqbool Hashmi et al. · 2017 · 134 citations

Cluster Computing, Gpu Architecture, Engineering +15

An In-depth Performance Characterization of CPU- and GPU-based DNN Training on Modern Architectures

Ammar Ahmad Awan, Hari Subramoni, Dhabaleswar K. Panda · 2017 · 75 citations

Convolutional Neural Network, Machine Vision, Machine Learning +14

DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale

Samyam Rajbhandari, Conglong Li, Zhewei Yao et al. · arXiv (Cornell University) · 2022 · 55 citations · Full text

Artificial Intelligence, Engineering, Machine Learning +20

Efficient Large Message Broadcast using NCCL and CUDA-Aware MPI for Deep Learning

Ammar Ahmad Awan, Khaled Hamidouche, Akshay Venkatesh et al. · 2016 · 50 citations

Cluster Computing, Engineering, Machine Learning +20