2007 · 11 citations · 9 references
ComputingComputer ScienceCybersecurityComputer SecurityMachine LearningNatural Language ProcessingClassificationPattern RecognitionText MiningApproximate Value FunctionsAutomated Text ClassificationClassification AlgorithmsCritical Point BehaviorCritical Point DetectionCritical Point EstimationDecision RulesText Classification
Many of standard classification algorithms usually assume that the training examples are evenly distributed among different classes. However, unbalanced data sets often appear in many applications. As a simple, effective categorization method, kNN is widely used, but it suffers from biased data sets, too. In developing the Prototype of Internet Information Security for Shanghai Council of Information and Security, we detect that when training data set is biased, almost all test documents of some rare categories are classified into common ones. To alleviate such a misfortune, we propose a novel concept, critical point (CP), and adapt traditional kNN by integrating CP's approximate value, LB or UB, training number with decision rules. Exhaustive experiments illustrate that the adapted kNN achieves significant classification performance improvement on biased corpora.
9
Mediators in the architecture of future information systems
Gio Wiederhold · Computer · 1992 · 2.2K citations
XML-based information mediation with MIX
Chaitan Baru, Amarnath Gupta, Bertram Ludäscher et al. · ACM SIGMOD Record · 1999 · 211 citations · Full text
A query language and optimization techniques for unstructured data
Peter Buneman, Susan B. Davidson, Gerd G. Hillebrand et al. · ACM SIGMOD Record · 1996 · 134 citations
Handling semantic heterogeneities using declarative agreements
Isabel F. Cruz, Afsheen Rajendran, William Sunna et al. · 2002 · 49 citations