Concepedia

Shannon Source Coding Theorem

The Shannon Source Coding Theorem is a fundamental theorem in information theory that establishes the theoretical limit for lossless data compression, specifying that the minimum average number of bits needed to represent each symbol of a source is bounded below by the source's entropy.

127

Publications

12.2K

Citations

176

Authors

95

Institutions

Publications per year

2017–2026

5

Variants

First Shannon TheoremShannon's Source Coding Theorem

Parents

Publications

127

Mathematical Foundations of Information Theory.

J. Laurie Snell, Aleksandr I︠A︡kovlevich Khinchin, Ray Silverman et al. · American Mathematical Monthly · 1959 · 1.5K citations

, , +12

The minimum description length principle in coding and modeling

Andrew R. Barron, J. Rissanen, Bin Yu · IEEE Transactions on Information Theory · 1998 · 1K citations

, , +16

Approximation theory of output statistics

Te Sun Han, Sergio Verdú · IEEE Transactions on Information Theory · 1993 · 666 citations

, , +15

Recent results in the Shannon theory

A.D. Wyner · IEEE Transactions on Information Theory · 1974 · 645 citations

, , +17

Elements of Information Theory, Wiley Series in Telecommunications

Thomas M. Cover, Thomas Allen · 1991 · 628 citations

, , +14

1–5 of 127

Authors

176

  1. RM
    Robert M. Gray

    Stanford University, United States

    7 publications · 375 citations

    7

    h-index

  2. RZ
    Ram Zamir

    Tel Aviv University, Israel

    4 publications · 314 citations

    4

    h-index

  3. AW
    A.D. Wyner

    AT&T (United States), United States

    4 publications · 1.2K citations

    4

    h-index

  4. AS
    Anant Sahai

    University of California, Berkeley, United States

    4 publications · 70 citations

    4

    h-index

  5. MG
    Michael Gastpar

    University of California, Berkeley, United States

    3 publications · 132 citations

    3

    h-index

1–5 of 176

Institutions

95

  1. University of California, Berkeley

    Berkeley, United States

    10 h-index

    16 publications

    1.6K citations

  2. Stanford University

    Stanford, United States

    6 h-index

    8 publications

    249 citations

  3. Massachusetts Institute of Technology

    Cambridge, United States

    6 h-index

    7 publications

    761 citations

  4. California Institute of Technology

    Pasadena, United States

    5 h-index

    8 publications

    596 citations

  5. Tel Aviv University

    Tel Aviv, Israel

    5 h-index

    11 publications

    433 citations

  6. University of Electro-Communications

    Tokyo, Japan

    5 h-index

    5 publications

    898 citations

  7. Tokyo Institute of Technology

    Tokyo, Japan

    4 h-index

    5 publications

    97 citations

  8. Technion – Israel Institute of Technology

    Haifa, Israel

    4 h-index

    5 publications

    121 citations

1–8 of 95

Venues

  1. IEEE Transactions on Information Theory

    50 publications · 5.8K citations

    31

    h-index

  2. 3

    h-index

  3. Proceedings of the IEEE

    3 publications · 108 citations

    3

    h-index

  4. The Annals of Probability

    2 publications · 53 citations

    2

    h-index

  5. Journal of the Franklin Institute

    2 publications · 43 citations

    2

    h-index

1–5