Cascaded multi-level medical image registration method based on transformer.
10.7507/1001-5515.202204011
- Author:
Yingjie PAN
1
;
Yuanzhi CHENG
1
;
Hao LIU
1
;
Cao SHI
1
Author Information
1. School of Information Science and Technology, QingDao University of Science and Technology, Qingdao, Shandong 266000, P. R. China.
- Publication Type:Journal Article
- Keywords:
Cascading network;
Difficult deformation perception;
Medical imaging;
Multi-level registration;
Self-attention mechanism
- MeSH:
Algorithms;
Neural Networks, Computer;
Image Processing, Computer-Assisted/methods*
- From:
Journal of Biomedical Engineering
2022;39(5):876-886
- CountryChina
- Language:Chinese
-
Abstract:
In deep learning-based image registration, the deformable region with complex anatomical structures is an important factor affecting the accuracy of network registration. However, it is difficult for existing methods to pay attention to complex anatomical regions of images. At the same time, the receptive field of the convolutional neural network is limited by the size of its convolution kernel, and it is difficult to learn the relationship between the voxels with far spatial location, making it difficult to deal with the large region deformation problem. Aiming at the above two problems, this paper proposes a cascaded multi-level registration network model based on transformer, and equipped it with a difficult deformable region perceptron based on mean square error. The difficult deformation perceptron uses sliding window and floating window techniques to retrieve the registered images, obtain the difficult deformation coefficient of each voxel, and identify the regions with the worst registration effect. In this study, the cascaded multi-level registration network model adopts the difficult deformation perceptron for hierarchical connection, and the self-attention mechanism is used to extract global features in the basic registration network to optimize the registration results of different scales. The experimental results show that the method proposed in this paper can perform progressive registration of complex deformation regions, thereby optimizing the registration results of brain medical images, which has a good auxiliary effect on the clinical diagnosis of doctors.
