Attention Is All You Need

Ashish Vaswani, Noam Shazeer, Niki Parmar, +5

EngineeringMachine LearningSelective AttentionCognitionCommunication +23

Conformer: Convolution-augmented Transformer for Speech Recognition

Anmol Gulati, James Qin, Chung‐Cheng Chiu, +8

EngineeringMachine LearningGlobal DependenciesSpeech RecognitionNatural Language Processing +16

Conformer: Convolution-augmented Transformer for Speech Recognition

Anmol Gulati, James Qin, Chung‐Cheng Chiu, +8

arXiv (Cornell University)

EngineeringMachine LearningGlobal DependenciesSpeech RecognitionNatural Language Processing +16

One Model To Learn Them All

Łukasz Kaiser, Aidan N. Gomez, Noam Shazeer, +4

arXiv (Cornell University)

Artificial IntelligenceEngineeringMachine LearningCoco DatasetMultistrategy Learning +14

Stand-Alone Self-Attention in Vision Models

Prajit Ramachandran, Niki Parmar, Ashish Vaswani, +3

arXiv (Cornell University)

Convolutional Neural NetworkEngineeringVision ModelsAttentionSocial Sciences +15

Image Transformer

Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, +4

arXiv (Cornell University)

Image GenerationMultimodal LlmImage AnalysisMachine VisionMachine Learning +11

Fast Decoding in Sequence Models using Discrete Latent Variables

Łukasz Kaiser, Aurko Roy, Ashish Vaswani, +4

arXiv (Cornell University)

Structured PredictionEngineeringMachine LearningAutoencodersRecurrent Neural Network +15

Purity homophily in social networks.

Morteza Dehghani, KATE JOHNSON, Joe Hoover, +6

Journal of Experimental Psychology General

Moral HomophilySocial PsychologyMoral IssueNetwork AnalysisSocial Influence +16

Corpora Generation for Grammatical Error Correction

Jared Lichtarge, Chris Alberti, Shankar Kumar, +3

Syntactic ParsingEngineeringPo TaggingCorpus LinguisticsLanguage Processing +16

Denoising Pretraining for Semantic Segmentation

Emmanuel Asiedu Brempong, Simon Kornblith, Ting Chen, +3

2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)

Convolutional Neural NetworkMachine VisionImage AnalysisData ScienceMachine Learning +13