EngineeringData PreparationSoftware AnalysisNew ErrorsData ScienceData MiningManagementData IntegrationBig DataData ManagementStatisticsPolicy DecisionsKnowledge DiscoveryData QualityComputer ScienceData CleansingData-driven ApplicationsData ValidationData-driven MethodsData TreatmentData Modeling
Data-driven applications rely on the correctness of their data to function properly and effectively. Errors in data can be incredibly costly and disruptive, leading to loss of revenue, incorrect conclusions, and misguided policy decisions. While data cleaning tools can purge datasets of many errors before the data is used, applications and users interacting with the data can introduce new errors. Subsequent valid updates can obscure these errors and propagate them through the dataset causing more discrepancies. Even when some of these discrepancies are discovered, they are often corrected superficially, on a case-by-case basis, further obscuring the true underlying cause, and making detection of the remaining errors harder.
66
Haibo He, Edwardo A. Garcia · IEEE Transactions on Knowledge and Data Engineering · 2009 · 9.2K citations
J. R. Quinlan · International Journal of Man-Machine Studies · 1987 · 2.5K citations
Data Cleaning: Problems and Current Approaches.
Erhard Rahm, Hai Hong · Qucosa (Saxon State and University Library Dresden) · 2000 · 1.4K citations · Full text