PLoS Computational Biology · 2019 · 52 citations · 47 references
Life SciencesBiologyCell BiologyComputational BiologyInformation TheorySignal TransductionSignal Transduction ModelingSingle-cell AnalysisAlgorithmic Information TheoryInformation Theory In BiologyRenyi Mutual InformationStatistical Learning Theory
Mathematical methods of information theory appear to provide a useful language to describe how stimuli are encoded in activities of signaling effectors. Exploring the information-theoretic perspective, however, remains conceptually, experimentally and computationally challenging. Specifically, existing computational tools enable efficient analysis of relatively simple systems, usually with one input and output only. Moreover, their robust and readily applicable implementations are missing. Here, we propose a novel algorithm, SLEMI-statistical learning based estimation of mutual information, to analyze signaling systems with high-dimensional outputs and a large number of input values. Our approach is efficient in terms of computational time as well as sample size needed for accurate estimation. Analysis of the NF-κB single-cell signaling responses to TNF-α reveals that NF-κB signaling dynamics improves discrimination of high concentrations of TNF-α with a relatively modest impact on discrimination of low concentrations. Provided R-package allows the approach to be used by computational biologists with only elementary knowledge of information theory.
47
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
Alexander Kraskov, Harald Stögbauer, Peter Grassberger · Physical Review E · 2004 · 4.1K citations · Full text
Howard C. Berg, Edward M. Purcell · Biophysical Journal · 1977 · 2K citations · Full text