Llama 2: Open Foundation and Fine-Tuned Chat Models

Hugo Touvron, Louis Martin, Kevin H. Stone, +65

arXiv (Cornell University)

Llm Fine-tuningChatbotEngineeringFine-tuned LlmsSpoken Dialog System +17

fairseq: A Fast, Extensible Toolkit for Sequence Modeling

Myle Ott, Sergey Edunov, Alexei Baevski, +5

Angela FanExtensible ToolkitEngineeringSequence AlignmentNatural Language Processing +17

Language Modeling with Gated Convolutional Networks

Yann Dauphin, Angela Fan, Michael Auli, +1

arXiv (Cornell University)

Structured PredictionEngineeringMachine LearningGated Convolutional NetworksMultilingual Pretraining +17

Language modeling with gated convolutional networks

Yann Dauphin, Angela Fan, Michael Auli, +1

International Conference on Machine Learning

Llm Fine-tuningEngineeringMachine LearningGated Convolutional NetworksMultilingual Pretraining +16

Beyond English-Centric Multilingual Machine Translation

Angela Fan, Shruti Bhosale, Holger Schwenk, +14

arXiv (Cornell University)

Llm Fine-tuningEngineeringMachine LearningLarge Language ModelCorpus Linguistics +15

Pay Less Attention with Lightweight and Dynamic Convolutions

Felix Wu, Angela Fan, Alexei Baevski, +2

arXiv (Cornell University)

Convolutional Neural NetworkEngineeringMachine LearningPay Less AttentionVideo Interpretation +17

Large Language Models for Software Engineering: Survey and Open Problems

Angela Fan, Beliz Gokkaya, Mark Harman, +4

Software MaintenanceEngineeringSoftware EngineeringLarge Language ModelSoftware Analysis +20

Strategies for Structuring Story Generation

Angela Fan, Mike Lewis, Yann Dauphin

EngineeringNarrative SummarizationNarrative TextsLong StoriesSemantics +17

fairseq: A Fast, Extensible Toolkit for Sequence Modeling

Myle Ott, Sergey Edunov, Alexei Baevski, +5

arXiv (Cornell University)

Artificial IntelligenceExtensible ToolkitEngineeringMachine LearningSequence Alignment +21

Reducing Transformer Depth on Demand with Structured Dropout

Angela Fan, Édouard Grave, Armand Joulin

arXiv (Cornell University)

Llm Fine-tuningEngineeringMachine LearningDepth MapLarge Language Model +14