Multi-task motor imagery electroencephalogram classification based on adaptive time-frequency common spatial pattern combined with convolutional neural network.
10.7507/1001-5515.202206052
- Author:
Ying HU
1
;
Yan LIU
2
;
Chenchen CHENG
3
;
Chen GENG
2
;
Bin DAI
1
;
Bo PENG
2
;
Jianbing ZHU
4
;
Yakang DAI
2
Author Information
1. School of Biomedical Engineering, University of Science and Technology of China, Hefei 230026, P. R. China.
2. Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, Jiangsu 215163, P. R. China.
3. School of Automation, Harbin University of Science and Technology, Harbin 150080, P. R. China.
4. Suzhou Science & Technology Town Hospital, Gusu School, Nanjing Medical University, Suzhou, Jiangsu 215163, P. R. China.
- Publication Type:Journal Article
- Keywords:
Brain-computer interface;
Common spatial pattern;
Convolutional neural network;
Motor imagery electroencephalogram;
Spatiotemporal-frequency domain feature fusion
- MeSH:
Humans;
Adult;
Imagination;
Neural Networks, Computer;
Imagery, Psychotherapy/methods*;
Electroencephalography/methods*;
Algorithms;
Brain-Computer Interfaces;
Signal Processing, Computer-Assisted
- From:
Journal of Biomedical Engineering
2022;39(6):1065-1073
- CountryChina
- Language:Chinese
-
Abstract:
The effective classification of multi-task motor imagery electroencephalogram (EEG) is helpful to achieve accurate multi-dimensional human-computer interaction, and the high frequency domain specificity between subjects can improve the classification accuracy and robustness. Therefore, this paper proposed a multi-task EEG signal classification method based on adaptive time-frequency common spatial pattern (CSP) combined with convolutional neural network (CNN). The characteristics of subjects' personalized rhythm were extracted by adaptive spectrum awareness, and the spatial characteristics were calculated by using the one-versus-rest CSP, and then the composite time-domain characteristics were characterized to construct the spatial-temporal frequency multi-level fusion features. Finally, the CNN was used to perform high-precision and high-robust four-task classification. The algorithm in this paper was verified by the self-test dataset containing 10 subjects (33 ± 3 years old, inexperienced) and the dataset of the 4th 2018 Brain-Computer Interface Competition (BCI competition Ⅳ-2a). The average accuracy of the proposed algorithm for the four-task classification reached 93.96% and 84.04%, respectively. Compared with other advanced algorithms, the average classification accuracy of the proposed algorithm was significantly improved, and the accuracy range error between subjects was significantly reduced in the public dataset. The results show that the proposed algorithm has good performance in multi-task classification, and can effectively improve the classification accuracy and robustness.