Cross modal translation of magnetic resonance imaging and computed tomography images based on diffusion generative adversarial networks.
10.7507/1001-5515.202404056
- Author:
Hong SHAO
1
;
Yixuan JING
1
;
Wencheng CUI
1
Author Information
1. School of Information Science and Engineering, Shenyang University of Technology, Shenyang 110870, P. R. China.
- Publication Type:Journal Article
- Keywords:
Computed tomography;
Cross-modal medical image translation;
Diffusion generated adversarial network;
Frequency decomposition;
Magnetic resonance imaging
- MeSH:
Humans;
Tomography, X-Ray Computed/methods*;
Magnetic Resonance Imaging/methods*;
Image Processing, Computer-Assisted/methods*;
Neural Networks, Computer;
Brain/diagnostic imaging*;
Algorithms;
Radiotherapy Planning, Computer-Assisted;
Generative Adversarial Networks
- From:
Journal of Biomedical Engineering
2025;42(3):575-584
- CountryChina
- Language:Chinese
-
Abstract:
To address the issues of difficulty in preserving anatomical structures, low realism of generated images, and loss of high-frequency image information in medical image cross-modal translation, this paper proposes a medical image cross-modal translation method based on diffusion generative adversarial networks. First, an unsupervised translation module is used to convert magnetic resonance imaging (MRI) into pseudo-computed tomography (CT) images. Subsequently, a nonlinear frequency decomposition module is used to extract high-frequency CT images. Finally, the pseudo-CT image is input into the forward process, while the high-frequency CT image as a conditional input is used to guide the reverse process to generate the final CT image. The proposed model is evaluated on the SynthRAD2023 dataset, which is used for CT image generation for radiotherapy planning. The generated brain CT images achieve a Fréchet Inception Distance (FID) score of 33.159 7, a structure similarity index measure (SSIM) of 89.84%, a peak signal-to-noise ratio (PSNR) of 35.596 5 dB, and a mean squared error (MSE) of 17.873 9. The generated pelvic CT images yield an FID score of 33.951 6, a structural similarity index of 91.30%, a PSNR of 34.870 7 dB, and an MSE of 17.465 8. Experimental results show that the proposed model generates highly realistic CT images while preserving anatomical accuracy as much as possible. The transformed CT images can be effectively used in radiotherapy planning, further enhancing diagnostic efficiency.
