2018 International Conference on Electrical, Electronics, Communication, Computer, and Optimization Techniques (ICEECCOT) · 2018 · 15 citations · 13 references
ComputingLinguisticsNatural Language ProcessingPhonologyReading ComprehensionDeep LearningSpeech PerceptionSpeech RecognitionAudio-visual Speech RecognitionConvolutional Neural NetworksSpeaker-dependent Speech Recognition
In this paper, a relative study of lip reading models based on convolutional neural networks (CNN), like AlexNet and Inception V3, has been carried out. The novelty of the paper lies in studying the performance of speaker dependent and speaker independent models, in predicting ten words, making use of the two aforementioned CNNs. In this process a dataset consisting of ten words, fifteen speakers' data named Miracl- VC1 has been used. From all the samples lip regions are extracted and concatenated for every word and used in training. Both the models are tested for known (speaker dependent) and unknown speakers (speaker independent). AlexNet reported the highest observed test accuracy of 86.6%, and Inception V3 reported an accuracy of 64.6% for speaker dependent Lip reading. Whereas, speaker independent test accuracies of both the models are at 37.1% in case of AlexNet and 17.6% for Inception-V3.
13
Rethinking the Inception Architecture for Computer Vision
Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe et al. · 2016 · 30.9K citations
One millisecond face alignment with an ensemble of regression trees
Vahid Kazemi, Josephine Sullivan · 2014 · 2.8K citations · Full text
Automatic lipreading to enhance speech recognition (speech reading)
E. Petajan · Pharmacology · 1984 · 328 citations