Concepedia

Joshua Ainslie

JA

14

Publications

1.7K

Citations

12

H-Index

2020

Active since

Affiliations

Google (United States)(Current)

Joshua Ainslie is an author at Google (United States) specializing in natural language processing, engineering, and machine translation.

Top concepts

EngineeringNatural Language ProcessingLinguisticsComputer ScienceMachine TranslationComputational LinguisticsLanguageMachine LearningData ScienceDeep Learning

Publications per year

2020–2023

14

Publications

14

FNet: Mixing Tokens with Fourier Transforms

James Lee-Thorp, Joshua Ainslie, Ilya Eckstein et al. · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · 2022 · 467 citations · Full text

Engineering, Machine Learning, Santiago Ontanon +19

Big Bird: Transformers for Longer Sequences

Manzil Zaheer, Guru Guruganesh, Avinava Dubey et al. · arXiv (Cornell University) · 2020 · 273 citations · Full text

Structured Prediction, Llm Fine-tuning, Engineering +20

ETC: Encoding Long and Structured Inputs in Transformers

Joshua Ainslie, Santiago Ontañón, Chris Alberti et al. · 2020 · 262 citations · Full text

Engineering, Part-of-speech Tagging, Joshua Ainslie +22

GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints

Joshua Ainslie, James Lee-Thorp, Michiel de Jong et al. · 2023 · 260 citations · Full text

Artificial Intelligence, Llm Fine-tuning, Engineering +23

LongT5: Efficient Text-To-Text Transformer for Long Sequences

Mandy Guo, Joshua Ainslie, David Uthus et al. · Findings of the Association for Computational Linguistics: NAACL 2022 · 2022 · 193 citations · Full text

Rows per page

1–5 of 14