BMC Bioinformatics · 2004 · 289 citations · 26 references
Life SciencesBioinformaticsBiostatisticsGene ExpressionGene Expression AnalysisInformation TheoryDifferential Expression AnalysisDifferential Gene Expression AnalysisGene Expression ProfilingInformation MeasuresMutual InformationB-spline Shape FunctionsBinningCorrelationGene ClusteringGene Expression CorrelationMutual Information AnalysisMutual Information EstimationSimilarity Measures
BACKGROUND: The information theoretic concept of mutual information provides a general framework to evaluate dependencies between variables. In the context of the clustering of genes with similar patterns of expression it has been suggested as a general quantity of similarity to extend commonly used linear measures. Since mutual information is defined in terms of discrete variables, its application to continuous data requires the use of binning procedures, which can lead to significant numerical errors for datasets of small or moderate size. RESULTS: In this work, we propose a method for the numerical estimation of mutual information from continuous data. We investigate the characteristic properties arising from the application of our algorithm and show that our approach outperforms commonly used algorithms: The significance, as a measure of the power of distinction from random correlation, is significantly increased. This concept is subsequently illustrated on two large-scale gene expression datasets and the results are compared to those obtained using other similarity measures.A C++ source code of our algorithm is available for non-commercial use from kloska@scienion.de upon request. CONCLUSION: The utilisation of mutual information as similarity measure enables the detection of non-linear correlations in gene expression datasets. Frequently applied linear correlation measures, which are often used on an ad-hoc basis without further justification, are thereby extended.
26
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
Quantitative Monitoring of Gene Expression Patterns with a Complementary DNA Microarray
Mark Schena, Dari Shalon, Ronald W. Davis et al. · Science · 1995 · 9.6K citations
Serial Analysis of Gene Expression
Victor E. Velculescu, Lin Zhang, Bert Vogelstein et al. · Science · 1995 · 3.7K citations