WebGuard: a Web filtering engine combining textual, structural, and visual content-based analysis

TLDR

The proliferation of objectionable content such as sex, violence, and racism on the Web necessitates effective classification and filtering tools, and WebGuard’s framework can be extended to other web‑site categorization problems. The study investigates and describes WebGuard, an automatic machine‑learning‑based pornographic web‑site classification and filtering system, to provide efficient tools for filtering undesirable content. WebGuard employs machine‑learning techniques that integrate textual, structural, and skin‑color visual content analysis, differing from commercial filters that rely mainly on keyword detection or black‑list checking. Experiments on 400 sites achieved 97.4 % classification accuracy, and on a 12,311‑site black list achieved 95.62 % accuracy.

Abstract

Along with the ever-growing Web comes the proliferation of objectionable content, such as sex, violence, racism, etc. We need efficient tools for classifying and filtering undesirable Web content. In this paper, we investigate this problem and describe WebGuard, an automatic machine learning-based pornographic Web site classification and filtering system. Unlike most commercial filtering products, which are mainly based on textual content-based analysis such as indicative keywords detection or manually collected black list checking, WebGuard relies on several major data mining techniques associated with textual, structural content-based analysis, and skin color related visual content-based analysis as well. Experiments conducted on a testbed of 400 Web sites including 200 adult sites and 200 nonpornographic ones showed WebGuard's filtering effectiveness, reaching a 97.4 percent classification accuracy rate when textual and structural content-based analysis was combined with visual content-based analysis. Further experiments on a black list of 12,311 adult Web sites manually collected and classified by the French Ministry of Education showed that WebGuard scored a 95.62 percent classification accuracy rate. The basic framework of WebGuard can apply to other categorization problems of Web sites which combine, as most of them do today, textual and visual content.