Concepedia

Publication | Open Access

UniDrop: A Simple yet Effective Technique to Improve Transformer without Extra Cost

DOIFull Paper Access

23

Citations

50

References

2021

Year

Zhen Wu, Lijun Wu, Qi Meng, Yingce Xia, Shufang Xie, Tao Qin, Xinyu Dai, Tie‐Yan Liu

Unknown Venue

Abstract

Zhen Wu, Lijun Wu, Qi Meng, Yingce Xia, Shufang Xie, Tao Qin, Xinyu Dai, Tie-Yan Liu. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2021.

References

YearCitations

Deep Residual Learning for Image Recognition

Kaiming He, Xiangyu Zhang, Shaoqing Ren,

2016

214.9K

Adam: A Method for Stochastic Optimization

Diederik P. Kingma, Jimmy Ba

UvA-DARE (University of Amsterdam)

2014

84.5K

MizAR 60 for Mizar 50

DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)

2023

73.5K

Dropout: a simple way to prevent neural networks from overfitting

Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky,

2014

34.2K

BLEU

Kishore Papineni, Salim Roukos, Todd J. Ward,

2001

20.9K

HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanities Use Case

Yinhan Liu, Myle Ott, Naman Goyal,

DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)

2019

17.1K

Sequence to Sequence Learning with Neural Networks

Ilya Sutskever, Oriol Vinyals, Quoc V. Le

arXiv (Cornell University)

2014

13.3K

Rectified Linear Units Improve Restricted Boltzmann Machines

Vinod Nair, Geoffrey E. Hinton

International Conference on Machine Learning

2010

13.2K

GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding

Alex Wang, Amanpreet Singh, Julian Michael,

2018

3.8K

Learning Word Vectors for Sentiment Analysis

Andrew L. Maas, Raymond E. Daly, Peter T. Pham,

2011

3.3K

Page 1