2017 · 62 citations · 33 references
ComputingCommunicationLanguage ProficiencyNatural Language ProcessingPsycholinguisticsConversational User InterfacesSpeech RecognitionCaptioningCaptioning For Deaf AudiencesCaptioning TechnologyHard Of Hearing IndividualsHard-of-hearing InterpretingSystematic Errors
Recent advances in Automatic Speech Recognition (ASR) have made this technology a potential solution for transcribing audio input in real-time for people who are Deaf or Hard of Hearing (DHH). However, ASR is imperfect; users must cope with errors in the output. While some prior research has studied ASR-generated transcriptions to provide captions for DHH people, there has not been a systematic study of how to best present captions that may include errors from ASR software nor how to make use of the ASR system's word-level confidence. We conducted two studies, with 21 and 107 DHH participants, to compare various methods of visually presenting the ASR output with certainty values. Participants answered subjective preference questions and provided feedback on how ASR captioning could be used with confidence display markup. Users preferred captioning styles with which they were already most familiar (that did not display confidence information), and they were concerned about the accuracy of ASR systems. While they expressed interest in systems that display word confidence during captions, they were concerned that text appearance changes may be distracting. The findings of this study should be useful for researchers and companies developing automated captioning systems for DHH users.
33
Rudolph Flesch · Journal of Applied Psychology · 1948 · 5.2K citations
Achieving Human Parity in Conversational Speech Recognition
Wayne Xiong, Jasha Droppo, Xuedong Huang et al. · arXiv (Cornell University) · 2016 · 479 citations · Full text
The microsoft 2016 conversational speech recognition system
Wayne Xiong, Jasha Droppo, Xuedong Huang et al. · 2017 · 337 citations · Full text
A historical perspective of speech recognition
Xuedong Huang, James D. Baker, Raj Reddy · Communications of the ACM · 2014 · 152 citations
Richang Hong, Meng Wang, Mengdi Xu et al. · 2010 · 101 citations
Health Professions, Speech-language Pathology, Assistive Technology +8