Physical Review Letters · 2016 · 69 citations · 64 references
Natural SciencesPhysicsInformation TheoryThermodynamicsUncertainty QuantificationEntropyEquilibrium ThermodynamicsNon-equilibrium ThermodynamicsStatistical MechanicsStatistical ThermodynamicsThermodynamic PropertiesClausius InequalityEntropy In Nonequilibrium ThermodynamicsEntropy In Statistical MechanicsInformation EntropyShannon EntropyThermodynamic EntropyVon Neumann Entropy
Thermodynamic entropy, as defined by Clausius, characterizes macroscopic observations of a system based on phenomenological quantities such as temperature and heat. In contrast, information-theoretic entropy, introduced by Shannon, is a measure of uncertainty. In this Letter, we connect these two notions of entropy, using an axiomatic framework for thermodynamics [E. H. Lieb and J. Yngvason Proc. R. Soc. 469, 20130408 (2013)]. In particular, we obtain a direct relation between the Clausius entropy and the Shannon entropy, or its generalization to quantum systems, the von Neumann entropy. More generally, we find that entropy measures relevant in nonequilibrium thermodynamics correspond to entropies used in one-shot information theory.
64
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
Information Theory and Statistical Mechanics
E. T. Jaynes · Physical Review · 1957 · 12.9K citations
Ryszard Horodecki, Paweł Horodecki, Michał Horodecki et al. · Reviews of Modern Physics · 2009 · 10K citations · Full text
Computing, Physics, Cryptography +16
Tillmann Baumgratz, M. Cramer, Martin B. Plenio · Physical Review Letters · 2014 · 2.7K citations · Full text