Brain Sciences · 2022 · 16 citations · 38 references
EngineeringBioengineeringBiomedical EngineeringNatural Language ProcessingNeural EngineeringPhoneticsDeep LearningElectromyogram AnalysisSpeech Motor ControlSpeech ProductionSpeech RecognitionSpeech SynthesisElectromyographyEncoder-decoder ArchitecturesNeural VocodersSequence-to-sequence GenerationSequence-to-sequence RecognitionSpeech DecodingSpeech Sound SynthesisSurface Electromyography
Silent speech decoding (SSD), based on articulatory neuromuscular activities, has become a prevalent task of brain-computer interfaces (BCIs) in recent years. Many works have been devoted to decoding surface electromyography (sEMG) from articulatory neuromuscular activities. However, restoring silent speech in tonal languages such as Mandarin Chinese is still difficult. This paper proposes an optimized sequence-to-sequence (Seq2Seq) approach to synthesize voice from the sEMG-based silent speech. We extract duration information to regulate the sEMG-based silent speech using the audio length. Then, we provide a deep-learning model with an encoder-decoder structure and a state-of-the-art vocoder to generate the audio waveform. Experiments based on six Mandarin Chinese speakers demonstrate that the proposed model can successfully decode silent speech in Mandarin Chinese and achieve a character error rate (CER) of 6.41% on average with human evaluation.
38
Natural TTS Synthesis by Conditioning Wavenet on MEL Spectrogram Predictions
Jonathan Shen, Ruoming Pang, Ron J. Weiss et al. · 2018 · 2.7K citations
ESPnet: End-to-End Speech Processing Toolkit
Shinji Watanabe, Takaaki Hori, Shigeki Karita et al. · 2018 · 1.3K citations
Montreal Forced Aligner: Trainable Text-Speech Alignment Using Kaldi
Michael McAuliffe, Michaela Socolof, Sarah Mihuc et al. · 2017 · 1.1K citations
A short-time objective intelligibility measure for time-frequency weighted noisy speech
Cees Taal, Richard C. Hendriks, Richard Heusdens et al. · 2010 · 1.1K citations