Information Theory

Information theory is a mathematical field that studies the quantification of information and the fundamental problems of signal transmission, reception, and processing through communication channels using principles from probability theory.

79.5K

Publications

5.6M

Citations

81.5K

Authors

8.4K

Institutions

Publications per year

2017–2026

16K

Parents

Electrical Engineering

Children

Channel CapacityChannel CodingEntropyError-correcting CodesFinite Blocklength Information TheoryHypothesis TestingInformation MeasuresInformation-theoretic CryptographyInformation-theoretic SecurityLossless Data Compression

Publications

79.5K

A Mathematical Theory of Communication

Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations

Engineering, Communication, Electrical Engineering +11

Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach

Fred S. Guthery, Kenneth P. Burnham, David Anderson · Journal of Wildlife Management · 2003 · 42.2K citations · Full text

Computing, Biostatistics, Bayesian Data Analysis +16

Compressed sensing

David L. Donoho · IEEE Transactions on Information Theory · 2006 · 23.1K citations

Natural Sciences, Computer Science, Mathematics +17

On Information and Sufficiency

S. Kullback, R. A. Leibler · The Annals of Mathematical Statistics · 1951 · 20K citations · Full text

Social Sciences, Economics, Information Theory +6

Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information

Emmanuel J. Candès, Justin Romberg, Terence Tao · IEEE Transactions on Information Theory · 2006 · 15.8K citations

Natural Sciences, Electrical Engineering, Mathematics +16

1–5 of 79.5K

Authors

81.5K

HV
H. Vincent Poor
Princeton University, United States
481 publications · 47.4K citations
99
h-index
GB
Georgios B. Giannakis
University of Minnesota, United States
209 publications · 24.9K citations
81
h-index
SS
Shlomo Shamai
Technion – Israel Institute of Technology, Israel
305 publications · 34.3K citations
78
h-index
SV
Sergio Verdú
Princeton University, United States
203 publications · 33.5K citations
74
h-index
ZD
Zhiguo Ding
University of Manchester, United Kingdom
216 publications · 24.2K citations
72
h-index

1–5 of 81.5K

Institutions

8.4K

1–8 of 8.4K

Venues

IEEE Transactions on Information Theory
5.6K publications · 781.7K citations
356
h-index
IEEE Transactions on Communications
3.8K publications · 302.5K citations
223
h-index
IEEE Transactions on Signal Processing
2.6K publications · 234.5K citations
211
h-index
Physical Review Letters
PRL · 983 publications · 197.9K citations
193
h-index
Physical Review A
PRA · 1.6K publications · 155.1K citations
177
h-index

1–5

See also Information Theory
Core Measures	Entropy Mutual Information Conditional Entropy Conditional Mutual Information Joint Entropy Multivariate Mutual Information Kullback-leibler Divergence Information Radius
Coding Theorems	Rate-distortion Theory Network Information Theory Channel Coding Theorems Source Coding Theorem Source-channel Separation Channel-optimized Source Coding Rate-distortion Coding
Channel Models	Discrete Memoryless Channels
Core Methods	Concentration Inequalities Logarithmic Sobolev Inequalities Azuma-hoeffding Inequality
Applications	Statistical Inference Machine Learning Cryptography Channel Coding Neuroscience Turbo Codes Hypothesis Testing Lossless Data Compression Low-density Parity-check Codes Lossy Data Compression