Mostofa Patwary - Concepedia

Author

Mostofa Patwary

Also Known As

Mahabaleshwarkar, Ameya Sunil, Md. Mostofa Ali Patwary, Mohammad Shoeybi, Mostofa Ali Patwary, Mostofa Patwary, Patwary Md. Mostofa Ali, Patwary, Md Mostofa Ali, Patwary, Md. Mostofa Ali, Patwary, Mostofa, Patwary, Mostofa Ali

Publications

2.2K

Citations

H-Index

Concepts

All Affiliations

Nvidia (United States)Nvidia (United Kingdom)University of Bergen Intel (United States)

About

Mostofa Patwary is an author at Nvidia (United States) specializing in engineering, computer science, and data science.

Top Concepts

#	Concept	H-Index	Publications	Citations
1	Engineering	14	14	2.1K
2	Computer Science	10	10	1.8K
3	Language Studies	6	6	1.4K
4	Computer Engineering	6	6	998
5	Business	2	2	54

Mostofa Patwary

Publications

2.1K

Citations

H-Index

Page 1

	Year	Citations
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism Mohammad Shoeybi, Mostofa Patwary, Raul Puri, arXiv (Cornell University) Llm Fine-tuningEngineeringMachine LearningComputer ArchitectureMultilingual Pretraining	2019	819
Scalable Bayesian Optimization Using Deep Neural Networks Jasper Snoek, Oren Rippel, Kevin Swersky, arXiv (Cornell University) Artificial IntelligenceModel OptimizationHyperparameter EstimationMachine VisionMachine Learning	2015	439
Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model Shaden Smith, Mostofa Patwary, Brandon Norick, arXiv (Cornell University) Artificial IntelligenceLlm Fine-tuningMegatron-turing Nlg 530BMachine LearningEngineering	2022	299
BioMegatron: Larger Biomedical Domain Language Model Hoo-Chang Shin, Yang Zhang, Evelina Bakhturina, EngineeringPart-of-speech TaggingLarge Language ModelCorpus LinguisticsLanguage Processing	2020	114
MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models Peng Xu, Mostofa Patwary, Mohammad Shoeybi, Artificial IntelligenceControllable Story GenerationEngineeringPeng XuNarrative Summarization	2020	102
Factuality Enhanced Language Models for Open-Ended Text Generation Nayeon Lee, Ping Wei, Peng Xu, arXiv (Cornell University) Llm Fine-tuningEngineeringOpen-ended Text GenerationMultilingual PretrainingSemantics	2022	54
Scalable parallel OPTICS data clustering using graph algorithmic techniques Mostofa Patwary, Diana Palsetia, Ankit Agrawal, Cluster ComputingEngineeringComputer ArchitectureHigh Performance ComputingParallel Metaheuristics	2013	52
Efficient large-scale language model training on GPU clusters using megatron-LM Deepak Narayanan, Mohammad Shoeybi, Jared Casper, Cluster ComputingLlm Fine-tuningEngineeringMachine LearningComputer Architecture	2021	38
Efficient Approximation Algorithms for Weighted $b$-Matching Arif Khan, Alex Pothen, Mostofa Patwary, SIAM Journal on Scientific Computing EngineeringComputer ArchitectureComputational ComplexityEfficient Approximation AlgorithmsGraph Matching	2016	36
Efficient Large-Scale Language Model Training on GPU Clusters Deepak Narayanan, Mohammad Shoeybi, Jared Casper, arXiv (Cornell University) Cluster ComputingEngineeringMachine LearningComputer ArchitectureLarge Language Model	2021	31

Page 1