Concepedia

Zero-shot Language Modeling

Zero-Shot Language Modeling is a language modeling paradigm in which a model generates predictions or performs tasks in the absence of explicit training examples for those tasks, relying solely on its pre-trained knowledge and implicit understanding of task descriptions.

219

Publications

18.3K

Citations

1K

Authors

184

Institutions

Publications per year

2017–2026

216

Parents

Publications

219

Scaling Instruction-Finetuned Language Models

Hyung Won Chung, Le Hou, Shayne Longpre et al. · arXiv (Cornell University) · 2022 · 1.2K citations · Full text

, , +14

Large Language Models are Zero-Shot Reasoners

Takeshi Kojima, Shixiang Gu, Machel Reid et al. · arXiv (Cornell University) · 2022 · 1.1K citations · Full text

, , +14

CLIP-Adapter: Better Vision-Language Models with Feature Adapters

Peng Gao, Shijie Geng, Renrui Zhang et al. · International Journal of Computer Vision · 2023 · 919 citations

, , +12

BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models

Junnan Li, Dongxu Li, Silvio Savarese et al. · arXiv (Cornell University) · 2023 · 915 citations · Full text

, , +12

Language models enable zero-shot prediction of the effects of mutations on protein function

Joshua Meier, Roshan Rao, Robert Verkuil et al. · bioRxiv (Cold Spring Harbor Laboratory) · 2021 · 670 citations · Full text

, , +17

1–5 of 219

Authors

1K

  1. LZ
    Luke Zettlemoyer

    University of Washington, United States

    10 publications · 666 citations

    10

    h-index

  2. AW
    Albert Webson

    John Brown University, United States

    8 publications · 2.5K citations

    8

    h-index

  3. MS
    Minjoon Seo

    Korea Advanced Institute of Science and Technology, South Korea

    5 publications · 110 citations

    5

    h-index

  4. SC
    Steven C. H. Hoi

    Nanyang Technological University, Singapore

    5 publications · 1.5K citations

    5

    h-index

  5. JL
    Junnan Li

    National University of Singapore, Singapore

    5 publications · 1.5K citations

    5

    h-index

1–5 of 1K

Institutions

184

  1. University of Washington

    Seattle, United States

    8 h-index

    25 publications

    4.9K citations

  2. Meta (Israel)

    Tel Aviv, Israel

    8 h-index

    36 publications

    4.9K citations

  3. University of California, Berkeley

    Berkeley, United States

    8 h-index

    18 publications

    2.4K citations

  4. Tsinghua University

    Beijing, China

    8 h-index

    67 publications

    3.5K citations

  5. Microsoft Research (United Kingdom)

    Cambridge, United Kingdom

    7 h-index

    18 publications

    608 citations

  6. Stanford University

    Stanford, United States

    7 h-index

    18 publications

    2.7K citations

  7. Hong Kong University of Science and Technology

    Hong Kong, Hong Kong

    7 h-index

    11 publications

    432 citations

  8. University of Hong Kong

    Pok Fu Lam, Hong Kong

    6 h-index

    22 publications

    1.1K citations

1–8 of 184

Venues

  1. arXiv (Cornell University)

    Repository · 87 publications · 8.3K citations

    33

    h-index

  2. 7

    h-index

  3. Proceedings of the AAAI Conference on Artificial Intelligence

    Conference · 6 publications · 192 citations

    6

    h-index

  4. SSRN Electronic Journal

    Repository · 3 publications · 56 citations

    3

    h-index

  5. 3

    h-index

1–5