2018 · 87 citations · 17 references
ComputingCommunicationComputer ScienceArtificial IntelligenceMachine LearningNatural Language ProcessingBullyingConversation AnalysisConversational User InterfacesDialogue SystemsOnline HarassmentSexual HarassmentAi ConversationArtificial Intelligence-driven HarassmentChatbot InteractionChatbot SystemsChatbotsData BiasHarassment DetectionHarassment In Social Media
Conversational AI systems are rapidly developing from purely transactional systems to social chatbots, which can respond to a wide variety of user requests. In this article, we establish how current state-of-the-art conversational systems react to inappropriate requests, such as bullying and sexual harassment on the part of the user, by collecting and analysing the novel #MeToo corpus. Our results show that commercial systems mainly avoid answering, while rule-based chatbots show a variety of behaviours and often deflect. Data-driven systems, on the other hand, are often noncoherent, but also run the risk of being interpreted as flirtatious and sometimes react with counter-aggression. This includes our own system, trained on "clean" data, which suggests that inappropriate system behaviour is not caused by data bias.
17
The Measurement of Observer Agreement for Categorical Data
J. Richard Landis, Gary G. Koch · Biometrics · 1977 · 78.9K citations · Full text
Sequence to Sequence Learning with Neural Networks
Ilya Sutskever, Oriol Vinyals, Quoc V. Le · arXiv (Cornell University) · 2014 · 13.4K citations · Full text
Computing, Computer Science, French +14
The American Psychological Association
Herbert Sidney Langfeld · Science · 1919 · 7.5K citations