2017 · 285 citations · 23 references
ComputingLinguisticsComputational LinguisticsNatural Language ProcessingText AnalyticsCorpus AnalysisHate SpeechLanguage ModelingN-gram AnalysisOpinion MiningSentiment AnalysisAutomated Hate Speech DetectionHate Speech AnnotationHate Speech CorporaSocial Media Hate SpeechSupervised ClassificationWord N-grams
In this paper we examine methods to detect hate speech in social media, while distinguishing this from general profanity. We aim to establish lexical baselines for this task by applying supervised classification methods using a recently released dataset annotated for this purpose. As features, our system uses character n-grams, word n-grams and word skip-grams. We obtain results of 78% accuracy in identifying posts across three classes. Results demonstrate that the main challenge lies in discriminating profanity and hate speech from each other. A number of directions for future work are discussed.
23
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Ron Kohavi · 1995 · 10.7K citations · Full text
LIBLINEAR: A Library for Large Linear Classification
Rong-En Fan, Kai‐Wei Chang, Cho‐Jui Hsieh et al. · 2008 · 6.6K citations
Abusive Language Detection in Online User Content
Chikashi Nobata, Joel Tetreault, Achint Thomas et al. · 2016 · 1.1K citations