2006 · 27 citations · 4 references
ComputingComputer ScienceInformation RetrievalNatural Language ProcessingText AnalyticsEvaluation Of Retrieval SystemsRetrieval ModelsSpeech RecognitionAccuracyRetrievalRetrieval Effectiveness MeasuresRetrieval Effectiveness MetricsRetrieval EvaluationSpeech RetrievalTopic BoundariesTrec Evaluation
Early speech retrieval experiments focused on news broadcasts, for which adequate Automatic Speech Recognition (ASR) accuracy could be obtained. Like newspapers, news broadcasts are a manually selected and arranged set of stories. Evaluation designs reflected that, using known story boundaries as a basis for evaluation. Substantial advances in ASR accuracy now make it possible to build search systems for some types of spontaneous conversational speech, but present evaluation designs continue to rely on known topic boundaries that are no longer well matched to the nature of the materials. We propose a new class of measures for speech retrieval based on manual annotation of points at which a user with specific topical interests would wish replay to begin.
4
Barry Arons · ACM Transactions on Computer-Human Interaction · 1997 · 184 citations · Full text
Supporting access to large digital oral history archives
Samuel Gustman, Dagobert Soergel, Douglas W. Oard et al. · 2002 · 41 citations