Concepedia

Kullback-leibler Divergence

Kullback-Leibler Divergence is a non-symmetric information-theoretic measure of the difference between two probability distributions, quantifying the expected number of extra bits required to code samples from one distribution when using a coding scheme optimized for another.

2.3K

Publications

175.4K

Citations

5.1K

Authors

1.6K

Institutions

Publications per year

2017–2026

732

Variants

Kl DivergenceKullback-leibler InformationRelative Entropy

Parents

Publications

2.3K

<i>REFMAC</i>5 for the refinement of macromolecular crystal structures

Garib N. Murshudov, Pavol Skubák, Andrey A. Lebedev et al. · Acta Crystallographica Section D Biological Crystallography · 2011 · 8.7K citations · Full text

, , +17

Likelihood Ratio Tests for Model Selection and Non-Nested Hypotheses

Quang Vuong · Econometrica · 1989 · 6K citations

, , +16

Algorithms for Non-negative Matrix Factorization

Daniel D. Lee, H. Sebastian Seung · 2000 · 5.5K citations

, , +15

Divergence measures based on the Shannon entropy

Jinfeng Lin · IEEE Transactions on Information Theory · 1991 · 5K citations

, , +13

ALGORITHMS FOR NON-NEGATIVE MATRIX FACTORIZATION

D Seung, Lin-Wen Lee · 2001 · 4.8K citations

, , +15

1–5 of 2.3K

Authors

5.1K

  1. FN
    Frank Nielsen

    Sony Computer Science Laboratories, Japan

    21 publications · 864 citations

    16

    h-index

  2. IV
    Igor Vajda

    Czech Academy of Sciences, Institute of Information Theory and Automation, Czechia

    11 publications · 1.1K citations

    11

    h-index

  3. AS
    Abd‐Krim Seghouane

    The University of Melbourne, Australia

    11 publications · 494 citations

    10

    h-index

  4. FK
    Frank K. Soong

    Microsoft Research Asia (China), China

    10 publications · 194 citations

    10

    h-index

  5. ES
    Ehsan S. Soofi

    University of Wisconsin–Milwaukee, United States

    10 publications · 683 citations

    10

    h-index

1–5 of 5.1K

Institutions

1.6K

  1. Centre National de la Recherche Scientifique

    Paris, France

    30 h-index

    113 publications

    6.5K citations

  2. University of Illinois Urbana-Champaign

    Urbana, United States

    25 h-index

    75 publications

    5.3K citations

  3. Princeton University

    Princeton, United States

    21 h-index

    46 publications

    3.6K citations

  4. Chinese Academy of Sciences

    Beijing, China

    19 h-index

    78 publications

    3.7K citations

  5. The University of Tokyo

    Tokyo, Japan

    19 h-index

    56 publications

    2.6K citations

  6. Massachusetts Institute of Technology

    Cambridge, United States

    19 h-index

    45 publications

    7.4K citations

  7. Australian National University

    Canberra, Australia

    17 h-index

    32 publications

    1.7K citations

  8. National University of Singapore

    Singapore, Singapore

    17 h-index

    30 publications

    2.5K citations

1–8 of 1.6K

Venues

  1. IEEE Transactions on Information Theory

    63 publications · 10.9K citations

    36

    h-index

  2. IEEE Transactions on Signal Processing

    52 publications · 3.1K citations

    32

    h-index

  3. arXiv (Cornell University)

    Repository · 98 publications · 3.7K citations

    32

    h-index

  4. The Annals of Statistics

    36 publications · 4K citations

    29

    h-index

  5. Entropy

    65 publications · 3.1K citations

    28

    h-index

1–5