The Scientific World JOURNAL · 2014 · 62 citations · 35 references
ComputingComputer ScienceFeature EngineeringInformation RetrievalMachine LearningClassificationFeature SelectionSearch SystemsWeb MiningWeb Performance OptimizationWeb SearchAnt Colony OptimizationAutomatic ClassificationHtml TagsInformation GainNaive BayesNaive Bayes ClassificationRuntime PerformanceWeb Page Classification
The explosive growth of web content has made automated web‑page classification essential for improving search engine performance, given the many features such as HTML tags, URLs, hyperlinks, and text. The study aims to reduce feature numbers to improve runtime and accuracy of web‑page classification. An ant colony optimization algorithm was used to select optimal features, after which C4.5, Naïve Bayes, and k‑nearest neighbor classifiers assigned class labels. Experiments on WebKB and Conference datasets showed that ACO‑based feature selection improves both accuracy and runtime, outperforming information‑gain and chi‑square methods.
The increased popularity of the web has caused the inclusion of huge amount of information to the web, and as a result of this explosive information growth, automated web page classification systems are needed to improve search engines’ performance. Web pages have a large number of features such as HTML/XML tags, URLs, hyperlinks, and text contents that should be considered during an automated classification process. The aim of this study is to reduce the number of features to be used to improve runtime and accuracy of the classification of web pages. In this study, we used an ant colony optimization (ACO) algorithm to select the best features, and then we applied the well-known C4.5, naive Bayes, and k nearest neighbor classifiers to assign class labels to web pages. We used the WebKB and Conference datasets in our experiments, and we showed that using the ACO for feature selection improves both accuracy and runtime performance of classification. We also showed that the proposed ACO based algorithm can select better features with respect to the well-known information gain and chi square feature selection methods.
35
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
An algorithm for suffix stripping
Martin Porter · Program electronic library and information systems · 1980 · 8.1K citations
Lecture Notes in Artificial Intelligence
Patrick Brézillon, Paolo Bouquet · 1999 · 7.4K citations
A Comparative Study on Feature Selection in Text Categorization
Yiming Yang, Jan Pedersen · 1997 · 4.8K citations