2014 · 14 citations · 9 references
ComputingComputer ScienceFeature EngineeringMachine LearningNatural Language ProcessingClassificationFeature ExtractionFeature SelectionText Feature EngineeringText MiningText Similarity AnalysisCosine SimilarityDimensionality ControlDocument ClassificationDocument SimilarityFeature Engineering For Text DataTerm WeightingText CategorizationTopic Classification
A major challenge in topic classification (TC) is the high dimensionality of the feature space. Therefore, feature extraction (FE) plays a vital role in topic classification in particular and text mining in general. FE based on cosine similarity score is commonly used to reduce the dimensionality of datasets with tens or hundreds of thousands of features, which can be impossible to process further. In this study, TF-IDF term weighting is used to extract features. Selecting relevant features and determining how to encode them for a learning machine method have a vast impact on the learning machine methods ability to extract a good model. Two different weighting methods (TF-IDF and TF-IDF Global) were used and tested on the Reuters-21578 text categorization test collection. The obtained results emerged a good candidate for enhancing the performance of English topics FE. Simulation results the Reuters-21578 text categorization show the superiority of the proposed algorithm.
9