2004 · 108 citations · 14 references
ComputingComputer ScienceData ManagementData MiningMachine LearningData QualityMissing Data HandlingMissing Data ImputationMissing Data MethodsNearest Neighbor SearchStatistical Software DevelopmentData ImputationHandling Missing ValuesImputation Of Missing ValuesK-nearest Neighbor ImputationK-nearest NeighborsK-nearest Neighbors ImputationMissing Value ImputationStatistical Testing
Studies in many different fields of research suffer from the problem of missing data. With missing data, statistical tests will lose power, results may be biased, or analysis may not be feasible at all. There are several ways to handle the problem, for example through imputation. With imputation, missing values are replaced with estimated values according to an imputation method or model. In the k-nearest neighbour (k-NN) method, a case is imputed using values from the k most similar cases. In this paper, we present an evaluation of the k-NN method using Likert data in a software engineering context. We simulate the method with different values of k and for different percentages of missing data. Our findings indicate that it is feasible to use the k-NN method with Likert data. We suggest that a suitable value of k is approximately the square root of the number of complete cases. We also show that by relaxing the method rules with respect to selecting neighbours, the ability of the method remains high for large amounts of missing data without affecting the quality of the imputation.
14
Pattern Classification and Scene Analysis
Michael Thompson, Richard O. Duda, Peter E. Hart · Leonardo · 1974 · 4.5K citations
Missing value estimation methods for DNA microarrays
Olga G. Troyanskaya, Michael Cantor, Gavin Sherlock et al. · Bioinformatics · 2001 · 4.3K citations · Full text
Improved Heterogeneous Distance Functions
D.R. Wilson, Tony Martinez · Journal of Artificial Intelligence Research · 1997 · 1.3K citations · Full text