2004 · 11 citations · 6 references
ComputingComputer ScienceComputer SystemsComputational LinguisticsNatural Language ProcessingProgramming LanguagesLanguage AssessmentLanguage ModelingLexical AnalysisMachine TranslationSpeech RecognitionTechnology AssessmentHuman Evaluation Of Machine TranslationSpeech Recognition EvaluationTranslation Evaluation Rubrics
We review some of the methodology applied to the various NIST language technology evaluations. We discuss the elements included in each evaluation plan, and suggest what we believe are key practices for successful evaluations, and what pitfalls should be avoided. A couple of lessons learned are noted.
6
The DET curve in assessment of detection task performance
Alvin F. Martín, George R. Doddington, Terri Kamm et al. · 1997 · 1.4K citations
NIST 2003 language recognition evaluation
Alvin F. Martín, Mark A. Przybocki · 2003 · 124 citations · Full text
The NIST Meeting Room Pilot Corpus
John S. Garofolo, Christophe Laprun, Martial Michel et al. · 2004 · 75 citations · Full text