Composite nystagmus classification framework enhanced by dual attention mechanism
10.3969/j.issn.1005-202X.2024.09.006
- VernacularTitle:基于双重注意力机制增强的复合型眼震分类框架
- Author:
Zhuoran WANG
1
;
Zhijun FANG
;
Hailing WANG
;
Yongbin GAO
;
Yuxia LI
Author Information
1. 上海工程技术大学电子电气工程学院,上海 201600
- Keywords:
medical image processing;
videonystagmography;
benign paroxysmal positional vertigo;
deep learning;
attention mechanism
- From:
Chinese Journal of Medical Physics
2024;41(9):1093-1103
- CountryChina
- Language:Chinese
-
Abstract:
A composite nystagmus classification framework enhanced by dual attention mechanism is proposed to address the problem that the existing researches only identify whether nystagmus occurs in a horizontal,vertical,or axial direction,but fail to consider the issue of composite nystagmus composed of multiple directions with various intensities in clinical practice.A spatiotemporal concentration algorithm for nystagmus videos is presented,and it combines convolutional neural networks and Hough transform to remove interference from invalid frames and regions and to improve the quality of nystagmus videos.Then,a dense optical flow algorithm is used to extract the optical flow field of eye movement.Finally,a composite nystagmus classification network based on dual attention mechanism enhancement is constructed.An improved efficient channel attention module is used to effectively obtain the direction and intensity of nystagmus in different channels of the optical flow map;and a temporal attention module is added at the end of the bidirectional long short-term memory network to achieve significant expression of classification results based on different temporal features.On the nystagmus dataset provided by the cooperating hospital,the proposed method has an accuracy rate of 83.17%for composite nystagmus classification,and achieved accuracy rates of 91.03%,89.74%,and 86.05%for individual horizontal,vertical,and axial nystagmus classifications.The proposed method realizes the intelligent classification of composite nystagmus and is valuable in clinic.
