Brain Sciences · 2020 · 42 citations · 45 references
EngineeringNeuroscienceFeature EngineeringMachine LearningNeural EngineeringBrain-computer InterfacesDeep LearningElectromyogram AnalysisMuscle Signal ProcessingNeural InterfacesSpeech RecognitionConvolutional Neural NetworksDeep Feature LearningElectromyographyElectromyography Feature ExtractionLong Short-term Memory NetworksMuscle Signal Feature ExtractionSpeech DecodingSurface Electromyography
Silent speech decoding is a novel application of the Brain-Computer Interface (BCI) based on articulatory neuromuscular activities, reducing difficulties in data acquirement and processing. In this paper, spatial features and decoders that can be used to recognize the neuromuscular signals are investigated. Surface electromyography (sEMG) data are recorded from human subjects in mimed speech situations. Specifically, we propose to utilize transfer learning and deep learning methods by transforming the sEMG data into spectrograms that contain abundant information in time and frequency domains and are regarded as channel-interactive. For transfer learning, a pre-trained model of Xception on the large image dataset is used for feature generation. Three deep learning methods, Multi-Layer Perception, Convolutional Neural Network and bidirectional Long Short-Term Memory, are then trained using the extracted features and evaluated for recognizing the articulatory muscles' movements in our word set. The proposed decoders successfully recognized the silent speech and bidirectional Long Short-Term Memory achieved the best accuracy of 90%, outperforming the other two algorithms. Experimental results demonstrate the validity of spectrogram features and deep learning algorithms.
45
Dropout: a simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky et al. · 2014 · 34.3K citations
Xception: Deep Learning with Depthwise Separable Convolutions
François Chollet · 2017 · 19K citations
Hoo-Chang Shin, Holger R. Roth, Mingchen Gao et al. · IEEE Transactions on Medical Imaging · 2016 · 5.8K citations · Full text