Nitish Shirish Keskar

CTRL: A Conditional Transformer Language Model for Controllable Generation

Nitish Shirish Keskar, Bryan McCann, Lav R. Varshney et al. · arXiv (Cornell University) · 2019 · 786 citations · Full text

Engineering, Machine Learning, Control Codes +19

On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima

Nitish Shirish Keskar, Dheevatsa Mudigere, Jorge Nocedal et al. · arXiv (Cornell University) · 2016 · 576 citations · Full text

Artificial Intelligence, Model Optimization, Neural Scaling Law +12

Regularizing and Optimizing LSTM Language Models

Stephen Merity, Nitish Shirish Keskar, Richard Socher · arXiv (Cornell University) · 2017 · 468 citations · Full text

Llm Fine-tuning, Engineering, Machine Learning +17

Improving Generalization Performance by Switching from Adam to SGD

Nitish Shirish Keskar, Richard Socher · arXiv (Cornell University) · 2017 · 403 citations · Full text

Structured Prediction, Llm Fine-tuning, Engineering +16

The Natural Language Decathlon: Multitask Learning as Question Answering

Bryan McCann, Nitish Shirish Keskar, Caiming Xiong et al. · arXiv (Cornell University) · 2018 · 338 citations · Full text

Llm Fine-tuning, Engineering, Machine Learning +18