Exploring the Limits of Transfer Learning with a Unified Text-to-Text\n Transformer

Colin Raffel, Noam Shazeer, Adam Roberts, +6

arXiv (Cornell University)

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Colin Raffel, Noam Shazeer, Adam P. Roberts, +6

arXiv (Cornell University)

Llm Fine-tuningEngineeringMachine LearningText-to-text TransformerMultilingual Pretraining +17

Llama 2: Open Foundation and Fine-Tuned Chat Models

Hugo Touvron, Louis Martin, Kevin H. Stone, +65

arXiv (Cornell University)

Llm Fine-tuningChatbotEngineeringFine-tuned LlmsSpoken Dialog System +17

Deep Speech 2: End-to-End Speech Recognition in English and Mandarin

Dario Amodei, Rishita Anubhai, Eric Battenberg, +31

arXiv (Cornell University)

EngineeringMachine LearningSpoken Language ProcessingHpc TechniquesMultilingual Pretraining +17

PaLM: Scaling Language Modeling with Pathways

Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, +62

arXiv (Cornell University)

Artificial IntelligenceLlm Fine-tuningEngineeringMachine LearningGeneration Benchmarks +17

Mixed Precision Training

Paulius Micikevicius, Sharan Narang, Jonah Alben, +8

arXiv (Cornell University)

Artificial IntelligenceNeural Scaling LawConvolutional Neural NetworkDeep Neural NetworksEngineering +13

Deep Learning Scaling is Predictable, Empirically

Joel Hestness, Sharan Narang, Newsha Ardalani, +6

arXiv (Cornell University)

Artificial IntelligencePower-law ExponentsLarge Ai ModelNeural Scaling LawEngineering +10

Deep Voice 3: Scaling Text-to-Speech with Convolutional Sequence\n Learning

Wei Ping, Kainan Peng, Andrew Gibiansky, +5

arXiv (Cornell University)

Deep Voice 3: 2000-Speaker Neural Text-to-Speech

Wei Ping, Kainan Peng, Andrew Gibiansky, +5

arXiv (Cornell University)

EngineeringMachine LearningSingle-gpu ServerSpeech RecognitionNatural Language Processing +18

ByT5: Towards a Token-Free Future with Pre-trained Byte-to-Byte Models

Linting Xue, Aditya Barua, Noah Constant, +5

Transactions of the Association for Computational Linguistics

Llm Fine-tuningEngineeringMachine LearningComputer ArchitectureNew Model Architectures +22