Publication | Open Access
MUC-5 evaluation metrics
284
Citations
0
References
1993
Year
Unknown Venue
Muc-5 Evaluation MetricsEngineeringQuality MetricEducationMajor UpdateCommunicationProgram EvaluationNatural Language ProcessingInformation RetrievalData ScienceComputational LinguisticsStatisticsError CorrectionPerformance MetricReliabilityMessage PassingEvaluationComputer ScienceEvaluation MeasureCurrent MetricsEvaluation Protocol
The metrics used for the Fifth Message Understanding Conference (MUC-5) evaluation are a major update to those used for MUC-4 in 1992. The official MUC-5 metrics express error rates while the official MUC-4 metrics express performance in terms of recall and precision (used for MUC-5 only as "unofficial" metrics). This paper discusses the current metrics and the reasons for their adoption.