Concepedia

Shannon Entropy

Shannon Entropy is an information measure that quantifies the average level of uncertainty or information content associated with the outcomes of a random variable by computing the expected value of the logarithmic probabilities of its possible states.

4.1K

Publications

219.2K

Citations

9.8K

Authors

3.2K

Institutions

Publications per year

2017–2026

1.5K

Variants

Information Entropy

Parents

Publications

4.1K

Divergence measures based on the Shannon entropy

Jinfeng Lin · IEEE Transactions on Information Theory · 1991 · 5K citations

, , +13

Good error-correcting codes based on very sparse matrices

David Mackay · IEEE Transactions on Information Theory · 1999 · 3.7K citations

, , +17

Entropy-based algorithms for best basis selection

Ronald R. Coifman, Mladen Victor Wickerhauser · IEEE Transactions on Information Theory · 1992 · 3.2K citations

, , +16

Altered fecal microbiota composition in patients with major depressive disorder

Hai‐yin Jiang, Yonghua Zhang, Hongjin Mao et al. · Brain Behavior and Immunity · 2015 · 2.3K citations · Full text

, , +16

On the Shannon capacity of a graph

László Lovász · IEEE Transactions on Information Theory · 1979 · 1.7K citations

, , +8

1–5 of 4.1K

Authors

9.8K

  1. RP
    Robin P. Sagar

    Universidad Autónoma Metropolitana, Mexico

    20 publications · 749 citations

    17

    h-index

  2. JS
    J. S. Dehesa

    Universidad de Granada, Spain

    20 publications · 865 citations

    16

    h-index

  3. YD
    Yong Deng

    University of Electronic Science and Technology of China, China

    18 publications · 972 citations

    16

    h-index

  4. RF
    Roman F. Nalewajski

    Jagiellonian University, Poland

    14 publications · 384 citations

    14

    h-index

  5. HN
    Hamidreza Namazi

    Monash University Malaysia, Malaysia

    20 publications · 444 citations

    14

    h-index

1–5 of 9.8K

Institutions

3.2K

  1. Centre National de la Recherche Scientifique

    Paris, France

    27 h-index

    61 publications

    3.2K citations

  2. Universidad de Granada

    Granada, Spain

    26 h-index

    44 publications

    2K citations

  3. Universidad Autónoma Metropolitana

    Mexico City, Mexico

    24 h-index

    33 publications

    1.2K citations

  4. Stanford University

    Stanford, United States

    22 h-index

    29 publications

    2.2K citations

  5. Massachusetts Institute of Technology

    Cambridge, United States

    21 h-index

    24 publications

    2.8K citations

  6. Chinese Academy of Sciences

    Beijing, China

    20 h-index

    31 publications

    1.1K citations

  7. Tsinghua University

    Beijing, China

    19 h-index

    29 publications

    1.3K citations

  8. University of North Carolina at Chapel Hill

    Chapel Hill, United States

    18 h-index

    26 publications

    1.4K citations

1–8 of 3.2K

Venues

  1. IEEE Transactions on Information Theory

    155 publications · 26.4K citations

    62

    h-index

  2. Entropy

    242 publications · 8.9K citations

    46

    h-index

  3. Physical Review A

    PRA · 45 publications · 3.5K citations

    32

    h-index

  4. arXiv (Cornell University)

    Repository · 60 publications · 2.6K citations

    26

    h-index

  5. Physical Review Letters

    PRL · 33 publications · 3.7K citations

    26

    h-index

1–5