arXiv (Cornell University) · 2020 · 87 citations · 26 references
BusinessArabicInformation SystemsComputational LinguisticsNatural Language ProcessingText AnalyticsCyberbullyingHate SpeechOpinion MiningSentiment AnalysisArabic Part-of-speech TaggingAutomated Hate Speech DetectionHarassment DetectionHate Speech AnnotationHate Speech CorporaHate Speech MeasurementOnline ExperimentsSocial Media Hate Speech
Detecting offensive language on Twitter has many applications ranging from detecting/predicting bullying to measuring polarization. In this paper, we focus on building a large Arabic offensive tweet dataset. We introduce a method for building a dataset that is not biased by topic, dialect, or target. We produce the largest Arabic dataset to date with special tags for vulgarity and hate speech. We thoroughly analyze the dataset to determine which topics, dialects, and gender are most associated with offensive tweets and how Arabic speakers use offensive language. Lastly, we conduct many experiments to produce strong results (F1 = 83.2) on the dataset using SOTA techniques.
26