Proceedings · 2006 · 30 citations · 16 references
ComputingComputer ScienceData ScienceData AnalyticsData MiningDatabasesNearest Neighbor SearchScalable Data MiningBrute-force SearchCorrelationCorrelation AnalysisCorrelation Pattern MiningPearson Correlation CoefficientUpper Bound Computation
Recently, there has been considerable interest in computing strongly correlated pairs in large databases. Most previous studies require the specification of a minimum correlation threshold to perform the computation. However, it may be difficult for users to provide an appropriate threshold in practice, since different data sets typically have different characteristics. To this end, we propose an alternative task: mining the top-k strongly correlated pairs. In this paper, we identify a 2-D monotone property of an upper bound of Pearson's correlation coefficient and develop an efficient algorithm, called TOP-COP to exploit this property to effectively prune many pairs even without computing their correlation coefficients. Our experimental results show that the TOP-COP algorithm can be orders of magnitude faster than brute-force alternatives for mining the top-k strongly correlated pairs.
16
Mining association rules between sets of items in large databases
Rakesh Agrawal, Tomasz Imieliński, Arun Swami · 1993 · 14.8K citations · Full text
Nonparametrics: Statistical Methods Based on Ranks
Mitchell J. Mergenthaler, E. L. Lehmann · Technometrics · 1979 · 3.4K citations
P. A. P. Moran, M. G. Kendall · Journal of the Royal Statistical Society Series A (General) · 1951 · 2.7K citations
Sergey Brin, Rajeev Motwani, Craig Silverstein · 1997 · 1.3K citations