2018 · 17 citations · 36 references
ComputingComputer ScienceComputational LinguisticsNatural Language ProcessingText AnalyticsHate SpeechLanguage ModelingN-gram AnalysisNamed Entity RecognitionWord EmbeddingsWritten CorporaCharacter N-gram AnalysisCharacter N-gramsHate Speech CorporaLow-dimensional EmbeddingsN-gram ClassificationSparse Text RepresentationsWord N-gramsWord Representation Learning
In this study, we aim to classify comments as abusive or non-abusive. We develop a Hebrew corpus of user comments annotated for abusive language. Then, we investigate highly sparse n-grams representations as well as denser character n-grams representations for comment abuse classification. Since the comments in social media are usually short, we also investigate four dimension reduction methods, which produce word vectors that collapse similar words into groups. We show that the character n-grams representations outperform all the other representation for the task of identifying abusive comments.
36
The Measurement of Observer Agreement for Categorical Data
J. Richard Landis, Gary G. Koch · Biometrics · 1977 · 78.9K citations · Full text
Distributed Representations of Words and Phrases and their Compositionality
Tomáš Mikolov, Ilya Sutskever, Kai Chen et al. · arXiv (Cornell University) · 2013 · 18.1K citations · Full text