Procedia Computer Science · 2015 · 89 citations · 13 references
ComputingData ScienceHealth InformaticsBig Data AnalyticsData MiningHealth Data AnalyticsAnomaly DetectionCluster DetectionData CleaningData PreprocessingDimensionality ReductionOutlier DetectionAccuracyCluster-based Outlier DetectionDistance-based Outlier DetectionHigh-dimensional Data ClusteringHigh-dimensional Outlier DetectionOutlier IdentificationOutlier RemovalOutlier Scoring
Outliers has been studied in a variety of domains including Big Data, High dimensional data, Uncertain data, Time Series data, Biological data, etc. In majority of the sample datasets available in the repository, atleast 10% of the data may be erroneous, missing or not available. In this paper, we utilize the concept of data preprocessing for outlier reduction. We propose two algorithms namely Distance-Based outlier detection and Cluster-Based outlier algorithm for detecting and removing outliers using a outlier score. By cleaning the dataset and clustering based on similarity, we can remove outliers on the key attribute subset rather than on the full dimensional attributes of dataset. Experiments were conducted using 3 built-in Health care dataset available in R package and the results show that the cluster-based outlier detection algorithm providing better accuracy than distance based outlier detection algorithm.
13
Outlier Detection for Temporal Data: A Survey
Manish Gupta, Jing Gao, Charų C. Aggarwal et al. · IEEE Transactions on Knowledge and Data Engineering · 2014 · 983 citations
Enhancing data analysis with noise removal
Hui Xiong, Gaurav Pandey, Michael Steinbach et al. · IEEE Transactions on Knowledge and Data Engineering · 2006 · 230 citations · Full text
Efficient Clustering-Based Outlier Detection Algorithm for Dynamic Data Stream
Manzoor Elahi, Kun Li, Wasif Nisar et al. · 2008 · 85 citations
Computing, Data Science, Data Mining +15
Robust outlier detection using the instability factor
Jihyun Ha, Seulgi Seok, Jong‐Seok Lee · Knowledge-Based Systems · 2014 · 70 citations
Computing, Data Science, Data Mining +12