Gabriel Pereyra

Regularizing Neural Networks by Penalizing Confident Output Distributions

Gabriel Pereyra, George Tucker, Jan Chorowski et al. · arXiv (Cornell University) · 2017 · 379 citations · Full text

Natural Language Processing, Large Ai Model, Structured Prediction +11

Large scale distributed neural network training through online\n distillation

Rohan Anil, Gabriel Pereyra, Alexandre Passos et al. · arXiv (Cornell University) · 2018 · 205 citations · Full text

Large scale distributed neural network training through online distillation

Rohan Anil, Gabriel Pereyra, Alexandre Passos et al. · arXiv (Cornell University) · 2018 · 152 citations · Full text

Engineering, Machine Learning, Distributed Ai System +16

OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization

Srinivasan Iyer, Xi Victoria Lin, Ramakanth Pasunuru et al. · arXiv (Cornell University) · 2022 · 85 citations · Full text

Second Language Learning, Artificial Intelligence, Llm Fine-tuning +19

Batch normalized recurrent neural networks

César Laurent, Gabriel Pereyra, Philémon Brakel et al. · 2016 · 14 citations · Full text

Structured Prediction, Engineering, Machine Learning +16