Concepedia

Repulsive Attention: Rethinking Multi-head Attention as Bayesian Inference

Bang An, Jie Lyu, Zhenyi Wang, Chunyuan Li, Changwei Hu, Fei Tan, Ruiyi Zhang, Yifan Hu, Changyou Chen

2020 · 17 citations · 32 references

DOIFull text

Open access

Concepts

Abstract

Bang An, Jie Lyu, Zhenyi Wang, Chunyuan Li, Changwei Hu, Fei Tan, Ruiyi Zhang, Yifan Hu, Changyou Chen. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2020.

References

32

Deep Residual Learning for Image Recognition

Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text

, , +11

Adam: A Method for Stochastic Optimization

Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text

, , +16

MizAR 60 for Mizar 50

DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2023 · 76.3K citations · Full text

, , +14

AI-Assisted Pipeline for Dynamic Generation of Trustworthy Health Supplement Content at Scale

DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2018 · 45.7K citations · Full text

, , +12

Densely Connected Convolutional Networks

Gao Huang, Zhuang Liu, Laurens van der Maaten et al. · 2017 · 44.7K citations

, , +10