The Semantics Latent in Shannon Information

Abstract

The lore is that standard information theory provides an analysis of information quantity, but not of information content. I argue this lore is incorrect, and there is an adequate informational semantics latent in standard theory. The roots of this notion of content can be traced to the secret parallel development of an information theory equivalent to Shannon’s by Turing at Bletchley Park, and it has been suggested independently in recent work by Skyrms and Bullinaria and Levy. This article explicitly articulates the semantics latent in information theory and defends it as an adequate theory of information content, or natural meaning. I argue that this theory suggests a new perspective on the classic misrepresentation worry for correlation-based semantics. 1 Introduction2 From Correlation to Meaning3 S-Vector Semantics4 Meaning for Inference5 Natural Meaning of Conventional Symbols6 Error and Ergodicity7 Conclusion