Information Overview

Principles

Definition

Information is a concept referring to data, signals, or symbols that possess meaning or convey knowledge within a context. It is fundamentally concerned with representation, transmission, storage, processing, and interpretation, often involving the reduction of uncertainty or the capacity to affect an outcome or understanding. As a research domain and theoretical construct, information is investigated across disciplines for its properties, flow, structure, value, and role in systems ranging from biological and physical processes to communication, computation, and social organization. Its significance lies in its foundational role in understanding communication, knowledge representation, decision-making, and system dynamics across various fields of study.

Ontological type

Core Theories

Quantification Measures

Representation Models

Key developments

Key Figures

Quantitative Information Measurement era

Across 1912–1948, representative figures converged on quantifying microscopic order and information in physical systems, pairing Langmuir's adsorption work with Boltzmann's and Gibbs's formal theories of entropy and ensembles, and culminating in Shannon's and Wiener's information-focused contributions. Irving Langmuir's 1918 adsorption isotherm and later Langmuir–Blodgett film techniques delivered concrete metrics for adsorption, surface area, and interfacial energetics that anchored experimental quantification in surface science. Boltzmann's statistical mechanics and Gibbs's ensemble framework linked uncertainty to macroscopic laws, providing a rigorous conceptual bridge from physical order to information content. In 1948 Claude Shannon formulated a mathematical theory of information and entropy for communication, while Norbert Wiener advanced cybernetics and feedback control, collectively institutionalizing information as a calculable quantity across physics, materials science, and nascent communications.

Information Limits and Capacity era

A.D. Wyner[1] pursued research during this era at the Weizmann Institute of Science[2] and Columbia University[3]. His key contribution in this era is the introduction of The Wire-Tap Channel[4], a model that formalized secrecy capacity and showed how information could be transmitted securely over noisy channels, thereby clarifying the role of capacity limits in secure communication. This work laid foundational groundwork for information-theoretic security and influenced later developments in coding theory and system design, aligning with the era's emphasis on formal limits. By tying physical resource constraints to information measures, Wyner's work helped unify engineering practice with theoretical bounds and underscored the importance of reliable and secure communication for information limits.

Information-Theoretic Learning era

Alex Pentland[1] is affiliated with Massachusetts Institute of Technology[3] and Stanford University[4] during the information-theoretic learning era. His Eigenfaces for Recognition[7] demonstrated scalable representation learning by projecting high-dimensional facial data into a compact eigenspace, a contribution that helped shape subsequent information-theoretic approaches to representation learning and regularization in high-dimensional data. Peter J. Winzer[2] is associated with Université Paris-Saclay[5] and Eindhoven University of Technology[6] during this era. His Capacity Limits of Optical Fiber Networks[8] articulated fundamental capacity limits and practical considerations for high-speed fiber systems, anchoring information-theoretic perspectives on communication efficiency and uncertainty-aware design in the era.