Physical Review Letters · 1989 · 1K citations · 9 references
Natural SciencesComputer ScienceMathematicsDynamical SystemsInformation TheoryProbability TheoryAlgorithmic ComplexityComputational ComplexityEntropyInformation MeasuresNonlinear DynamicsStatistical MechanicsComplexity MeasuresInformation ComplexityMeasure-theoretic EntropyModel ComplexityNonlinear Dynamical SystemsPeriod-doubling CascadesRecursive StructureStatistical Mechanics Of Entropy
Statistical mechanics is used to describe the observed information processing complexity of nonlinear dynamical systems. We introduce a measure of complexity distinct from and dual to the information theoretic entropies and dimensions. A technique is presented that directly reconstructs minimal equations of motion from the recursive structure of measurement sequences. Application to the period-doubling cascade demonstrates a form of superuniversality that refers only to the entropy and complexity of a data stream.
9
Introduction to automata theory, languages, and computation
Computer Languages · 1980 · 6.9K citations
Three models for the description of language
Noam Chomsky · IEEE Transactions on Information Theory · 1956 · 2.8K citations
ON THE MATHEMATICAL THEORY OF COMMUNICATION
Yoichiro Takada · The Japanese journal of psychology · 1954 · 1.7K citations · Full text
On the Length of Programs for Computing Finite Binary Sequences
Gregory J. Chaitin · Journal of the ACM · 1966 · 912 citations · Full text