A Transformer Convolutional Network With the Method of Image Segmentation for EEG-Based Emotion Recognition

Abstract

Electroencephalogram (EEG) based emotion recognition has become an important topic in humancomputer interaction and affective computing. However, existing advanced methods still have some problems. Firstly, using too many electrodes will decrease the practicality of EEG acquisition device. Secondly, transformer is not good at extracting local features. Finally, differential entropy (DE) is unsuitable for extracting features outside the 2-44Hz frequency band. To solve these problems, we designed a neural network using 14 electrodes, utilizing differential entropy and designed spectrum sum (SS) to extract features, using convolutional neural networks and image segmentation techniques to learn local features, and transformer encoders to learn global features. The model outperformed advanced methods with classification results of 98.50% and 99.00% on the SEED-IV and SEED-V datasets. The code is released at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/zxylctrl/CIT-NET</uri> .