Vijay Anand Korthikanti

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

Shaden Smith, Mostofa Patwary, Brandon Norick et al. · arXiv (Cornell University) · 2022 · 299 citations · Full text

Artificial Intelligence, Llm Fine-tuning, Megatron-turing Nlg 530B +21

Synthesizing geometry constructions

Sumit Gulwani, Vijay Anand Korthikanti, Ashish Tiwari · ACM SIGPLAN Notices · 2011 · 91 citations

Geometry Constructions, Engineering, Geometry +21

Synthesizing geometry constructions

Sumit Gulwani, Vijay Anand Korthikanti, Ashish Tiwari · 2011 · 67 citations

Geometry Constructions, Engineering, Geometry +21

Reducing Activation Recomputation in Large Transformer Models

Vijay Anand Korthikanti, Jared Casper, Sangkug Lym et al. · arXiv (Cornell University) · 2022 · 52 citations · Full text

Llm Fine-tuning, Engineering, Machine Learning +17

Towards optimizing energy costs of algorithms for shared memory architectures

Vijay Anand Korthikanti, Gul Agha · 2010 · 51 citations

Cluster Computing, Engineering, Energy Efficiency +23