Concepedia

Shaden Smith

SS

14

Publications

1.1K

Citations

14

H-Index

2014

Active since

Affiliations

University of Minnesota(Current)

Intel (United States)

Intel (United Kingdom)

University of Minnesota System

Shaden Smith is an author at University of Minnesota specializing in engineering, computer science, and parallel programming.

Top concepts

EngineeringComputer ScienceData ScienceParallel ComputingParallel ProgrammingMachine LearningComputer EngineeringComputer ArchitectureComputational ScienceBig Data

Publications per year

2014–2022

14

Publications

14

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

Shaden Smith, Mostofa Patwary, Brandon Norick et al. · arXiv (Cornell University) · 2022 · 299 citations · Full text

Artificial Intelligence, Llm Fine-tuning, Megatron-turing Nlg 530B +21

SPLATT: Efficient and Parallel Sparse Tensor-Matrix Multiplication

Shaden Smith, Niranjay Ravindran, Nicholas D. Sidiropoulos et al. · 2015 · 215 citations

Massively-parallel Computing, Computational Science, Array Computing +13

Tensor-matrix products with a compressed sparse tensor

Shaden Smith, George Karypis · 2015 · 131 citations

Mathematical Programming, Engineering, Machine Learning +17

Tensaurus: A Versatile Accelerator for Mixed Sparse-Dense Tensor Computations

Nitish Srivastava, Hanchen Jin, Shaden Smith et al. · 2020 · 117 citations

Array Computing, Engineering, Machine Learning +15

Truss decomposition on shared-memory parallel systems

Shaden Smith, Xing Liu, Nesreen K. Ahmed et al. · 2017 · 52 citations

Engineering, Distributed Algorithms, Computer Architecture +22

Rows per page

1–5 of 14