Communications of the ACM · 2022 · 12 citations · 21 references
ComputingComputer SystemsInformation TechnologyAcousticsInternet Of ThingsMobile ComputingHearing Assistive DevicesHearing ImpairmentHearing LossMobile SensingWearable Health TechnologiesSmart WatchesSound FeedbackWearable Audio Systems
Smartwatches have the potential to provide glanceable, always-available sound feedback to people who are deaf or hard of hearing (DHH). We present SoundWatch, a smartwatch-based deep learning application to sense, classify, and provide feedback about sounds occurring in the environment. To design SoundWatch, we first examined four low-resource sound classification models across four device architectures: watch-only, watch+phone, watch+phone+cloud, and watch+cloud. We found that the best model, VGG-lite, performed similar to the state of the art for nonportable devices although requiring substantially less memory (∼1/3 rd ) and that the watch+phone architecture provided the best balance among CPU, memory, network usage, and latency. Based on these results, we built and conducted a lab evaluation of our smartwatch app with eight DHH participants. We found support for our sound classification app but also uncovered concerns with misclassifications, latency, and privacy.
21
Using thematic analysis in psychology
Virginia Braun, Victoria Clarke · Qualitative Research in Psychology · 2006 · 183.3K citations · Full text
Social Sciences, Psychology, Communication Research Methods +10
CNN architectures for large-scale audio classification
Shawn Hershey, Sourish Chaudhuri, Daniel P. W. Ellis et al. · 2017 · 2.5K citations
Real-time discrimination of broadcast speech/music
J. Saunders · 2002 · 473 citations
Computing, Linguistics, Phonetics +16