2007 · 10 citations · 8 references
EngineeringIntelligent Information RetrievalVerificationQa SystemCorpus LinguisticsText MiningNatural Language ProcessingInformation RetrievalData ScienceComputational LinguisticsAutomatic ValidationPrecise InformationLanguage StudiesQa SystemsMachine TranslationQuestion AnsweringComputer ScienceInformation ExtractionSemantic ParsingRetrieval Augmented GenerationAutomated ReasoningLinguisticsComputational SemanticsInteractive Information Retrieval
Question answering (QA) aims at retrieving precise information from a large collection of documents. Different techniques can be used to find relevant information, and to compare these techniques, it is important to evaluate QA systems. The objective of an Answer Validation task is thus to judge the correctness of an answer returned by a QA system for a question, according to the text snippet given to support it. We participated in such a task in 2006. In this article, we present our strategy for deciding if the snippets justify the answers: a strategy based on our own QA system, comparing the answers it returned with the answer to judge. We discuss our results, then we point out the difficulties of this task.
8
The Seventh PASCAL Recognizing Textual Entailment Challenge.
Luisa Bentivogli, Peter E. Clark, Ido Dagan et al. · 2008 · 579 citations