Entropy · 2020 · 27 citations · 14 references
Natural SciencesBiostatisticsInformation TheoryStatistical ComputingStatisticsDependence ModelingHypothesis TestingInferential StatisticsMutual InformationStatistical AnalysisConditional Mutual InformationCorrelationDependence StructureMutual Information AnalysisMutual Information EstimationNonlinear DependencePearson Correlation CoefficientRandomness Tests
The analysis of independence between statistical randomness tests has had great attention in the literature recently. Dependency detection between statistical randomness tests allows one to discriminate statistical randomness tests that measure similar characteristics, and thus minimize the amount of statistical randomness tests that need to be used. In this work, a method for detecting statistical dependency by using mutual information is proposed. The main advantage of using mutual information is its ability to detect nonlinear correlations, which cannot be detected by the linear correlation coefficient used in previous work. This method analyzes the correlation between the battery tests of the National Institute of Standards and Technology, used as a standard in the evaluation of randomness. The results of the experiments show the existence of statistical dependencies between the tests that have not been previously detected.
14
Pierre L’Ecuyer, Richard Simard · ACM Transactions on Mathematical Software · 2007 · 998 citations
On Normalized Mutual Information: Measure Derivations and Properties
Tarald O. Kvålseth · Entropy · 2017 · 153 citations · Full text
Empirical Estimation of Information Measures: A Literature Guide
Sergio Verdú · Entropy · 2019 · 62 citations · Full text