Infoscience (Ecole Polytechnique Fédérale de Lausanne) · 2004 · 89 citations · 11 references
Open access
ComputingComputer ScienceInformation RetrievalNatural Language ProcessingPerformance MeasurementEvaluation Of Retrieval SystemsPerformance EvaluationRetrieval ModelsSpeech RecognitionSpeech Recognition TestingAutomatic RecognitionError Rate AnalysisError Rate MetricsRetrieval EvaluationSpeech Recognition AccuracySpeech Recognition EvaluationSpeech RetrievalWord Error Rate
Abstract. This paper discusses the evaluation of automatic speech recognition (ASR) systems developed for practical applications, suggesting a set of criteria for application-oriented performance measures. The commonly used word error rate (WER), which poses ASR evaluation as a string editing process, is shown to have a number of limitations with respect to these criteria, motivating alternative or additional measures. This paper suggests that posing speech recognition evaluation as an information retrieval problem, where each word is one unit of information, offers a flexible framework for application-oriented performance analysis based on the concepts of recall and precision. 2 IDIAP–RR 04-73 1
11
Binary codes capable of correcting deletions, insertions and reversals
V.I. Levenshtein · Soviet physics. Doklady · 1965 · 10.4K citations
PERFORMANCE MEASURES FOR INFORMATION EXTRACTION
John Makhoul, Francis Kubala, Richard Schwartz et al. · 2007 · 513 citations