Cardiac magnetic resonance image segmentation based on lightweight network and knowledge distillation strategy.
10.7507/1001-5515.202312015
- Author:
Zeqi LIU
1
;
Ning WANG
1
;
Chong ZHANG
1
;
Guohui WEI
1
Author Information
1. College of Intelligence and Information Engineering, Shandong University of Traditional Chinese Medicine, Jinan 250355, P. R. China.
- Publication Type:Journal Article
- Keywords:
Deep learning;
Knowledge distillation;
Lightweight network;
Medical image segmentation
- MeSH:
Humans;
Magnetic Resonance Imaging/methods*;
Neural Networks, Computer;
Heart/diagnostic imaging*;
Deep Learning;
Image Processing, Computer-Assisted/methods*;
Algorithms
- From:
Journal of Biomedical Engineering
2024;41(6):1204-1212
- CountryChina
- Language:Chinese
-
Abstract:
To address the issue of a large number of network parameters and substantial floating-point operations in deep learning networks applied to image segmentation for cardiac magnetic resonance imaging (MRI), this paper proposes a lightweight dilated parallel convolution U-Net (DPU-Net) to decrease the quantity of network parameters and the number of floating-point operations. Additionally, a multi-scale adaptation vector knowledge distillation (MAVKD) training strategy is employed to extract latent knowledge from the teacher network, thereby enhancing the segmentation accuracy of DPU-Net. The proposed network adopts a distinctive way of convolutional channel variation to reduce the number of parameters and combines with residual blocks and dilated convolutions to alleviate the gradient explosion problem and spatial information loss that might be caused by the reduction of parameters. The research findings indicate that this network has achieved considerable improvements in reducing the number of parameters and enhancing the efficiency of floating-point operations. When applying this network to the public dataset of the automatic cardiac diagnosis challenge (ACDC), the dice coefficient reaches 91.26%. The research results validate the effectiveness of the proposed lightweight network and knowledge distillation strategy, providing a reliable lightweighting idea for deep learning in the field of medical image segmentation.
