Statistics
Publications
6
Citations
732
H-Index
6
Active since
2020
Affiliations
Google (United States)(Current)
Anirudh Ravula is an author at Google (United States) specializing in computing, attention, and natural language processing.
Publications per year
2020–2022
6
6
Big Bird: Transformers for Longer Sequences
Manzil Zaheer, Guru Guruganesh, Avinava Dubey et al. · arXiv (Cornell University) · 2020 · 273 citations · Full text
ETC: Encoding Long and Structured Inputs in Transformers
Joshua Ainslie, Santiago Ontañón, Chris Alberti et al. · 2020 · 270 citations · Full text
RealFormer: Transformer Likes Residual Attention
Ruining He, Anirudh Ravula, Bhargav Kanagal et al. · 2021 · 81 citations · Full text
ETC: Encoding Long and Structured Inputs in Transformers
Joshua Ainslie, Santiago Ontañón, Chris Alberti et al. · arXiv (Cornell University) · 2020 · 28 citations · Full text
1–5 of 6