Concepedia

Contextualized Embeddings

Contextualized Embeddings is a type of distributed representation in natural language processing that, unlike static embeddings, generates word or token vectors dynamically based on the surrounding context within a sentence or document, thereby capturing nuanced semantic and syntactic meanings specific to each usage instance.

397

Publications

24.8K

Citations

1.1K

Authors

396

Institutions

Publications per year

2017–2026

372

Parents

Publications

397

Deep Contextualized Word Representations

Matthew E. Peters, Mark E Neumann, Mohit Iyyer et al. · 2018 · 1.8K citations · Full text

, , +16

Dependency-Based Word Embeddings

Omer Levy, Yoav Goldberg · 2014 · 1.1K citations · Full text

, , +13

Med-BERT: pretrained contextualized embeddings on large-scale structured electronic health records for disease prediction

Laila Rasmy, Yang Xiang, Ziqian Xie et al. · npj Digital Medicine · 2021 · 828 citations · Full text

, , +13

LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention

Ikuya Yamada, Akari Asai, Hiroyuki Shindo et al. · 2020 · 564 citations · Full text

, , +16

MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance

Wei Zhao, Maxime Peyrard, Fei Liu et al. · 2019 · 478 citations · Full text

, , +15

1–5 of 397

Authors

1.1K

  1. YZ
    Yue Zhang

    Westlake University, China

    8 publications · 391 citations

    8

    h-index

  2. RR
    Roi Reichart

    Technion – Israel Institute of Technology, Israel

    6 publications · 323 citations

    6

    h-index

  3. HS
    Hinrich Schütze

    Ludwig-Maximilians-Universität München, Germany

    6 publications · 305 citations

    6

    h-index

  4. BV
    Benjamin Van Durme

    Johns Hopkins University, United States

    6 publications · 678 citations

    6

    h-index

  5. WC
    Wanxiang Che

    Harbin Institute of Technology, China

    5 publications · 271 citations

    5

    h-index

1–5 of 1.1K

Institutions

396

  1. Google (United States)

    Mountain View, United States

    14 h-index

    41 publications

    2.8K citations

  2. University of Washington

    Seattle, United States

    10 h-index

    17 publications

    1.1K citations

  3. Carnegie Mellon University

    Pittsburgh, United States

    9 h-index

    25 publications

    3K citations

  4. University of Southern California

    Los Angeles, United States

    8 h-index

    22 publications

    957 citations

  5. Technion – Israel Institute of Technology

    Haifa, Israel

    7 h-index

    19 publications

    963 citations

  6. Johns Hopkins University

    Baltimore, United States

    7 h-index

    21 publications

    1.4K citations

  7. Westlake University

    Hangzhou, China

    7 h-index

    18 publications

    861 citations

  8. Stanford University

    Stanford, United States

    7 h-index

    15 publications

    501 citations

1–8 of 396

Venues

  1. arXiv (Cornell University)

    Repository · 80 publications · 3.6K citations

    32

    h-index

  2. Proceedings of the AAAI Conference on Artificial Intelligence

    Conference · 14 publications · 651 citations

    12

    h-index

  3. IEEE Access

    10 publications · 523 citations

    10

    h-index

  4. 6

    h-index

  5. 5

    h-index

1–5