Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · 2022 · 45 citations · 38 references
ComputingComputer ScienceComputational LinguisticsInformation RetrievalNatural Language ProcessingAnnotationArgumentationConversation AnalysisCoreference ResolutionDialogue AnalysisDialogue SystemsBenchmark Dataset DesignBenchmark Dataset DevelopmentBenchmark Dataset EvaluationCoreference In DialogueDialogue Corpus ConstructionDialogue EvaluationFactuality DetectionRetrieval
Fact-checking is an essential tool to mitigate the spread of misinformation and disinformation. We introduce the task of fact-checking in dialogue, which is a relatively unexplored area. We construct DIALFACT, a testing benchmark dataset of 22,245 annotated conversational claims, paired with pieces of evidence from Wikipedia. There are three sub-tasks in DIALFACT: 1) Verifiable claim detection task distinguishes whether a response carries verifiable factual information; 2) Evidence retrieval task retrieves the most relevant Wikipedia snippets as evidence; 3) Claim verification task predicts a dialogue response to be supported, refuted, or not enough information. We found that existing fact-checking models trained on non-dialogue data like FEVER We point out unique challenges in DIALFACT such as handling the colloquialisms, coreferences and retrieval ambiguities in the error analysis to shed light on future research in this direction 1 .
38
The Curious Case of Neural Text Degeneration
Ari Holtzman, Jan Buys, Li Du et al. · arXiv (Cornell University) · 2019 · 1.1K citations · Full text
A Stylometric Inquiry into Hyperpartisan and Fake News
Martin Potthast, Johannes Kiesel, Kevin Reinartz et al. · 2018 · 691 citations · Full text
Public Affairs, Political Communication, Political Science +17