2002 · 139 citations · 5 references
ComputingComputer ScienceComputational LinguisticsNatural Language ProcessingWeb TechnologiesDialogue SystemsEvaluation Of Retrieval SystemsLanguage ModelingLanguage ModelsQuestion AnsweringRetrieval ModelsAnswer GenerationQuestion Answering SystemsQuestion Answering Systems Evaluation
The official evaluation of TREC-style Q&A systems is done manually, which is quite expensive and not scalable to web-based Q&A systems. An automatic evaluation technique is needed for dynamic Q&A systems. This paper presents a set of metrics that have been implemented in our web-based Q&A system, namely NSIR. It also shows the correlations between the different metrics. 1.
5
Scaling question answering to the Web
Cody C. T. Kwok, Oren Etzioni, Daniel S. Weld · 2001 · 327 citations
Probabilistic question answering on the web
Dragomir Radev, Weiguo Fan, Hong Qi et al. · 2002 · 110 citations
The Use of Predictive Annotation for Question Answering in TREC8.
John Prager, Dragomir Radev, Eric W. Brown et al. · 1999 · 83 citations
The TREC-8 Question Answering Track Evaluation
Ellen M. Voorhees, Dawn M. Tice · 1999 · 69 citations