2013 · 12 citations · 23 references
ComputingComputer ScienceData ScienceData MiningFeature EngineeringMachine LearningClassificationFeature SelectionMutual InformationVariable SelectionFeature Selection For ClassificationHigh-dimensional Data MiningHybrid Feature SelectionMutual Information AnalysisMutual Information EstimationMutual Information-based SelectionOptimization For High-dimensional DataPrediction Model Development
It is very important to select a small set of relevant features from a high dimensional data set and useful to design either an effective classification or prediction model. This procedure involves a series of estimations of the relationship between each pair of variables and between each variable and class labels. Mutual information is widely used to estimate these relationships. However, alternative strategies may be useful to estimate the mutual information with continuous or hybrid data. In this study, we attempt to evaluate the difference between the selection strategies involved with mutual information and fuzzy mutual information. The results indicate that using fuzzy mutual information is more helpful to obtain more stable feature sets and more accurate estimations of the relationship between two variables.
23
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
UCI Machine Learning Repository
Arthur Asuncion · Medical Entomology and Zoology · 2007 · 24.4K citations
Wrappers for feature subset selection
Ron Kohavi, George H. John · Artificial Intelligence · 1997 · 8.9K citations
Alexander Kraskov, Harald Stögbauer, Peter Grassberger · Physical Review E · 2004 · 4.1K citations · Full text