Journal of Neural Engineering · 2023 · 23 citations · 28 references
EngineeringNeurosciencePsychiatryComputational NeuroscienceMachine LearningNeural EngineeringElectroencephalogram AnalysisElectroencephalogram Signal ProcessingElectroencephalographyNeural Signal ProcessingNeurodevelopmental DisordersConvolutional Neural NetworksEeg Feature ExtractionEeg Signal ProcessingElectroencephalogram ClassificationElectroencephalography Feature ExtractionNeurodevelopmental Disorder DiagnosisTransformer ModelsTransformer-based Classification
Abstract Objective . Attention-deficit/hyperactivity disorder (ADHD) is the most common neurodevelopmental disorder in adolescents that can seriously impair a person’s attention function, cognitive processes, and learning ability. Currently, clinicians primarily diagnose patients based on the subjective assessments of the Diagnostic and Statistical Manual of Mental Disorders-5, which can lead to delayed diagnosis of ADHD and even misdiagnosis due to low diagnostic efficiency and lack of well-trained diagnostic experts. Deep learning of electroencephalogram (EEG) signals recorded from ADHD patients could provide an objective and accurate method to assist physicians in clinical diagnosis. Approach . This paper proposes the EEG-Transformer deep learning model, which is based on the attention mechanism in the traditional Transformer model, and can perform feature extraction and signal classification processing for the characteristics of EEG signals. A comprehensive comparison was made between the proposed transformer model and three existing convolutional neural network models. Main results . The results showed that the proposed EEG-Transformer model achieved an average accuracy of 95.85% and an average AUC value of 0.9926 with the fastest convergence speed, outperforming the other three models. The function and relationship of each module of the model are studied by ablation experiments. The model with optimal performance was identified by the optimization experiment. Significance . The EEG-Transformer model proposed in this paper can be used as an auxiliary tool for clinical diagnosis of ADHD, and at the same time provides a basic model for transferable learning in the field of EEG signal classification.
28
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov et al. · arXiv (Cornell University) · 2020 · 21.6K citations · Full text
Learning Texture Transformer Network for Image Super-Resolution
Fuzhi Yang, Huan Yang, Jianlong Fu et al. · 2020 · 942 citations