Language Models are Few-Shot Learners

T. B. Brown, Benjamin Mann, Nick Ryder, +28

arXiv (Cornell University)

Artificial IntelligenceFew-shot LearningLlm Fine-tuningEngineeringMachine Learning +18

PaLM: Scaling Language Modeling with Pathways

Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, +62

arXiv (Cornell University)

Artificial IntelligenceLlm Fine-tuningEngineeringMachine LearningGeneration Benchmarks +17

Scaling Laws for Neural Language Models

Jared Kaplan, Sam McCandlish, Tom Henighan, +7

arXiv (Cornell University)

Llm Fine-tuningEngineeringMachine LearningNeural Language ModelsMultilingual Pretraining +15

Generative Pretraining From Pixels

Mark Chen, Alec Radford, Rewon Child, +4

International Conference on Machine Learning

Image AnalysisMachine LearningEngineeringGenerative Adversarial NetworkGenerative Models +5

Generating Long Sequences with Sparse Transformers

Rewon Child, Scott Gray, Alec Radford, +1

arXiv (Cornell University)

EngineeringMachine LearningAutoencodersSequence DesignNatural Language Processing +15

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

Shaden Smith, Mostofa Patwary, Brandon Norick, +17

arXiv (Cornell University)

Artificial IntelligenceLlm Fine-tuningMegatron-turing Nlg 530BMachine LearningEngineering +19

Exploring neural transducers for end-to-end speech recognition

Eric Battenberg, Jitong Chen, Rewon Child, +6

2017 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU)

EngineeringMachine LearningNeurolinguisticsAttention-based Seq2seq ModelsSpoken Language Processing +18

Convolutional Recurrent Neural Networks for Small-Footprint Keyword Spotting

Sercan Ö. Arık, Markus Kliegl, Rewon Child, +5

EngineeringMachine LearningSpeech RecognitionNatural Language ProcessingData Science +15

Very Deep VAEs Generalize Autoregressive Models and Can Outperform Them\n on Images

Rewon Child

arXiv (Cornell University)

Exploring Neural Transducers for End-to-End Speech Recognition

Eric Battenberg, Jitong Chen, Rewon Child, +8

ArXiv.org

EngineeringMachine LearningNeurolinguisticsSpoken Language ProcessingRecurrent Neural Network +19