Concepedia

Attention Mechanisms

Attention Mechanism is a computational model in deep learning that selectively enhances or suppresses elements of input representations by dynamically assigning varying weights to different parts of the data, based on their relevance to the current processing task.

2.9K

Publications

328.8K

Citations

10.5K

Authors

2.1K

Institutions

Publications per year

2017–2026

2.4K

Parents

Publications

2.9K

MizAR 60 for Mizar 50

DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2023 · 76.3K citations · Full text

, , +14

ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks

Qilong Wang, Banggu Wu, Pengfei Zhu et al. · 2020 · 8.1K citations

, , +15

Show, Attend and Tell: Neural Image Caption Generation with Visual Attention

Kelvin Xu, Jimmy Ba, Ryan Kiros et al. · arXiv (Cornell University) · 2015 · 7.5K citations · Full text

, , +15

Attention Is All You Need

Ashish Vaswani, Noam Shazeer, Niki Parmar et al. · 2025 · 6.6K citations · Full text

, , +14

Coordinate Attention for Efficient Mobile Network Design

Qibin Hou, Daquan Zhou, Jiashi Feng · 2021 · 5.7K citations

, , +15

1–5 of 2.9K

Authors

10.5K

  1. BA
    Brian A. Anderson

    Texas A&M University, United States

    8 publications · 917 citations

    8

    h-index

  2. HH
    Haifeng Hu

    Sun Yat-sen University, China

    8 publications · 253 citations

    8

    h-index

  3. QH
    Qibin Hou

    Nankai University, China

    8 publications · 7.8K citations

    8

    h-index

  4. UA
    Ulrich Ansorge

    University of Vienna, Austria

    7 publications · 192 citations

    7

    h-index

  5. YT
    Yi Tay

    Nanyang Technological University, Singapore

    7 publications · 220 citations

    7

    h-index

1–5 of 10.5K

Institutions

2.1K

  1. Chinese Academy of Sciences

    Beijing, China

    43 h-index

    282 publications

    19.4K citations

  2. University of Chinese Academy of Sciences

    Beijing, China

    38 h-index

    153 publications

    12.1K citations

  3. Tsinghua University

    Beijing, China

    35 h-index

    159 publications

    41.6K citations

  4. Peking University

    Beijing, China

    28 h-index

    95 publications

    12.9K citations

  5. Zhejiang University

    Hangzhou, China

    28 h-index

    117 publications

    13.1K citations

  6. University of Science and Technology of China

    Hefei, China

    28 h-index

    115 publications

    11.2K citations

  7. Google (United States)

    Mountain View, United States

    28 h-index

    125 publications

    23.8K citations

  8. Northwestern Polytechnical University

    Xi'an, China

    28 h-index

    104 publications

    5K citations

1–8 of 2.1K

Venues

  1. arXiv (Cornell University)

    Repository · 349 publications · 36.1K citations

    71

    h-index

  2. IEEE Access

    128 publications · 4.9K citations

    42

    h-index

  3. Proceedings of the AAAI Conference on Artificial Intelligence

    Conference · 56 publications · 4.9K citations

    37

    h-index

  4. Remote Sensing

    59 publications · 3K citations

    30

    h-index

  5. 28

    h-index

1–5