1.Evaluating the Accuracy and Diagnostic Reasoning of Multimodal Large Language Models in Interpreting Neuroradiology Cases From RadioGraphics
Pae Sun SUH ; Ji Su KO ; Woo Hyun SHIM ; Hwon HEO ; Chang-Yun WOO ; Hyungjun PARK ; Chong Hyun SUH
Korean Journal of Radiology 2026;27(3):214-226
Objective:
To evaluate the accuracy and reasoning capabilities of large multimodal language models compared with those of neuroradiology subspecialty-trained radiologists in neuroradiology case interpretation.
Materials and Methods:
This experimental study used custom-made 401 radiologic quizzes derived from articles published in RadioGraphics covering neuroradiology and head and neck topics (October 2020 to February 2024). We prompted the GPT-4 Turbo with Vision (GPT-4V), GPT-4 Omni, Gemini Flash, and Claude models to provide the top three differential diagnoses with a rationale and describe examination characteristics such as imaging modality, sequence, use of contrast, image plane, and body part. The temperature was adjusted to 0 and 1 (T1). Two neuroradiologists answered the same questions.The accuracies of the large language models (LLMs) and the neuroradiologists were compared using generalized estimating equations. Three neuroradiologists assessed the rationale provided by the LLMs for their differential diagnoses using four-point scales, separately for specific lesion locations and imaging findings, and evaluated the presence of hallucinations and the overall acceptability of the responses.
Results:
Top-3 accuracy (i.e., correct answers present among top-3 differential diagnoses) of LLMs ranged from 29.9% (120 of 401) to 49.4% (198 of 401, obtained with GPT-4V in the T1 setting), while radiologists achieved 80.3% (322 of 401) and 68.3% (274 of 401), respectively (P < 0.001). Regarding the rationale for differential diagnoses, GPT-4V (T1) accurately identified both the specific lesion location and imaging findings in 30.7% (123 of 401) and 12.9% (16 of 124) of cases without textual clinical history. Hallucinations occurred in 4.5% (18 of 401), and only 29.4% (118 of 401) of the LLM-generated analyses were deemed acceptable. GPT-4V (T1) demonstrated high accuracy in identifying the imaging modality (97.4% [800 of 821]) and scanned body parts (92.2% [756 of 820]).
Conclusion
LLMs remarkably underperformed compared with neuroradiologists and showed unsatisfactory reasoning for their differential diagnoses, with performance declining further in cases without textual input of clinical history. These findings highlight the limitations of current multimodal LLMs in neuroradiological interpretation and their reliance on text input.
3.Aneuploidy rates and clinical outcomes in vitrified-warmed blastocyst transfer cycles: comparison of biopsy at fresh blastocyst versus vitrified-warmed blastocyst
Jun Woo KIM ; Sooyoung JEONG ; Jinkyung KO ; Jiyoung ANN ; Chang Young HUR ; Jin Ho LIM
Clinical and Experimental Reproductive Medicine 2026;53(2):121-127
Objective:
This study aimed to compare aneuploidy rates and clinical outcomes between trophectoderm biopsy at fresh blastocyst (biopsy-fresh) followed by vitrification and biopsy at vitrified-warmed blastocyst (biopsy-vitri) followed by next day transfer (without re-vitrification).
Methods:
This retrospective study included 844 patients undergoing 844 cycles conducted from August 2019 to December 2023. Preimplantation genetic testing for aneuploidy (PGT-A) was performed via trophectoderm biopsy using array comparative genomic hybridization or next-generation sequencing for comprehensive 24-chromosome screening. Patients were divided into two groups based on the blastocyst status at the time of biopsy: the biopsy-fresh group (531 patients) and the biopsy-vitri group (313 patients).
Results:
The clinical pregnancy rate was significantly higher in the biopsy-fresh group compared to the biopsy-vitri group (58.7% vs. 45.6%; odds ratio [OR], 1.695; 95% confidence interval [CI], 1.215 to 2.364; p=0.002). Furthermore, the biopsy-fresh group showed higher implantation rates (45.6% vs. 32.1%; OR, 1.767; 95% CI, 1.274 to 2.451; p=0.002), ongoing pregnancy or live birth rates per cycle (48.0% vs. 35.8%; OR, 1.652; 95% CI, 1.177 to 2.319; p=0.004), and rates of good-quality blastocysts (57.1% vs. 32.1%, p<0.001) compared with the biopsy-vitri group. Miscarriage rates did not differ significantly between the groups (18.2% vs. 21.4%; OR, 0.818; 95% CI, 0.457 to 1.465; p=0.501).
Conclusion
Biopsy at fresh blastocyst demonstrated superior clinical outcomes compared with biopsy at vitrified-warmed blastocyst, likely due to better embryo quality. Both biopsy at fresh blastocyst and vitrified-warmed blastocyst remain viable options for PGT-A, with biopsy at vitrified-warmed blastocyst serving as a practical alternative. Embryo quality and euploid status continue to be critical considerations for embryo transfer selection.
4.Prediction of Hemifacial Spasm Re-Appearing Phenomenon after Microvascular Decompression Surgery in Patients with Hemifacial Spasm Using Dynamic Susceptibility Contrast Perfusion Magnetic Resonance Imaging
Seung Hoon LIM ; Xiao-Yi GUO ; Hyug-Gi KIM ; Hak Cheol KO ; Soonchan PARK ; Chang-Woo RYU ; Geon-Ho JAHNG
Journal of Korean Neurosurgical Society 2025;68(1):46-59
Objective:
: Hemifacial spasm (HFS) is treated by a surgical procedure called microvascular decompression (MVD). However, HFS re-appearing phenomenon after surgery, presenting as early recurrence, is experienced by some patients after MVD. Dynamic susceptibility contrast (DSC) perfusion magnetic resonance imaging (MRI) and two analytical methods : receiver operating characteristic (ROC) curve and machine learning, were used to predict early recurrence in this study.
Methods:
: This study enrolled 60 patients who underwent MVD for HFS. They were divided into two groups : group A consisted of 32 patients who had early recurrence and group B consisted of 28 patients who had no early recurrence of HFS. DSC perfusion MRI was undergone by all patients before the surgery to obtain the several parameters. ROC curve and machine learning methods were used to predict early recurrence using these parameters.
Results:
: Group A had significantly lower relative cerebral blood flow than group B in most of the selected brain regions, as shown by the region-of-interest-based analysis. By combining three extraction fraction (EF) values at middle temporal gyrus, posterior cingulate, and brainstem, with age, using naive Bayes machine learning method, the best prediction model for early recurrence was obtained. This model had an area under the curve value of 0.845.
Conclusion
: By combining EF values with age or sex using machine learning methods, DSC perfusion MRI can be used to predict early recurrence before MVD surgery. This may help neurosurgeons to identify patients who are at risk of HFS recurrence and provide appropriate postoperative care.
5.Prediction of Hemifacial Spasm Re-Appearing Phenomenon after Microvascular Decompression Surgery in Patients with Hemifacial Spasm Using Dynamic Susceptibility Contrast Perfusion Magnetic Resonance Imaging
Seung Hoon LIM ; Xiao-Yi GUO ; Hyug-Gi KIM ; Hak Cheol KO ; Soonchan PARK ; Chang-Woo RYU ; Geon-Ho JAHNG
Journal of Korean Neurosurgical Society 2025;68(1):46-59
Objective:
: Hemifacial spasm (HFS) is treated by a surgical procedure called microvascular decompression (MVD). However, HFS re-appearing phenomenon after surgery, presenting as early recurrence, is experienced by some patients after MVD. Dynamic susceptibility contrast (DSC) perfusion magnetic resonance imaging (MRI) and two analytical methods : receiver operating characteristic (ROC) curve and machine learning, were used to predict early recurrence in this study.
Methods:
: This study enrolled 60 patients who underwent MVD for HFS. They were divided into two groups : group A consisted of 32 patients who had early recurrence and group B consisted of 28 patients who had no early recurrence of HFS. DSC perfusion MRI was undergone by all patients before the surgery to obtain the several parameters. ROC curve and machine learning methods were used to predict early recurrence using these parameters.
Results:
: Group A had significantly lower relative cerebral blood flow than group B in most of the selected brain regions, as shown by the region-of-interest-based analysis. By combining three extraction fraction (EF) values at middle temporal gyrus, posterior cingulate, and brainstem, with age, using naive Bayes machine learning method, the best prediction model for early recurrence was obtained. This model had an area under the curve value of 0.845.
Conclusion
: By combining EF values with age or sex using machine learning methods, DSC perfusion MRI can be used to predict early recurrence before MVD surgery. This may help neurosurgeons to identify patients who are at risk of HFS recurrence and provide appropriate postoperative care.
6.ERRATUM: Imaging follow-up strategy after endovascular treatment of intracranial aneurysms: A literature review and guideline recommendations
Yong-Hwan CHO ; Jaehyung CHOI ; Chae-Wook HUH ; Chang Hyeun KIM ; Chul Hoon CHANG ; Soon Chan KWON ; Young Woo KIM ; Seung Hun SHEEN ; Sukh Que PARK ; Jun Kyeung KO ; Sung-kon HA ; Hae Woong JEONG ; Hyen Seung KANG ;
Journal of Cerebrovascular and Endovascular Neurosurgery 2025;27(1):80-80
7.ERRATUM: Imaging follow-up strategy after endovascular treatment of intracranial aneurysms: A literature review and guideline recommendations
Yong-Hwan CHO ; Jaehyung CHOI ; Chae-Wook HUH ; Chang Hyeun KIM ; Chul Hoon CHANG ; Soon Chan KWON ; Young Woo KIM ; Seung Hun SHEEN ; Sukh Que PARK ; Jun Kyeung KO ; Sung-kon HA ; Hae Woong JEONG ; Hyen Seung KANG ;
Journal of Cerebrovascular and Endovascular Neurosurgery 2025;27(1):80-80
8.Prediction of Hemifacial Spasm Re-Appearing Phenomenon after Microvascular Decompression Surgery in Patients with Hemifacial Spasm Using Dynamic Susceptibility Contrast Perfusion Magnetic Resonance Imaging
Seung Hoon LIM ; Xiao-Yi GUO ; Hyug-Gi KIM ; Hak Cheol KO ; Soonchan PARK ; Chang-Woo RYU ; Geon-Ho JAHNG
Journal of Korean Neurosurgical Society 2025;68(1):46-59
Objective:
: Hemifacial spasm (HFS) is treated by a surgical procedure called microvascular decompression (MVD). However, HFS re-appearing phenomenon after surgery, presenting as early recurrence, is experienced by some patients after MVD. Dynamic susceptibility contrast (DSC) perfusion magnetic resonance imaging (MRI) and two analytical methods : receiver operating characteristic (ROC) curve and machine learning, were used to predict early recurrence in this study.
Methods:
: This study enrolled 60 patients who underwent MVD for HFS. They were divided into two groups : group A consisted of 32 patients who had early recurrence and group B consisted of 28 patients who had no early recurrence of HFS. DSC perfusion MRI was undergone by all patients before the surgery to obtain the several parameters. ROC curve and machine learning methods were used to predict early recurrence using these parameters.
Results:
: Group A had significantly lower relative cerebral blood flow than group B in most of the selected brain regions, as shown by the region-of-interest-based analysis. By combining three extraction fraction (EF) values at middle temporal gyrus, posterior cingulate, and brainstem, with age, using naive Bayes machine learning method, the best prediction model for early recurrence was obtained. This model had an area under the curve value of 0.845.
Conclusion
: By combining EF values with age or sex using machine learning methods, DSC perfusion MRI can be used to predict early recurrence before MVD surgery. This may help neurosurgeons to identify patients who are at risk of HFS recurrence and provide appropriate postoperative care.
9.ERRATUM: Imaging follow-up strategy after endovascular treatment of intracranial aneurysms: A literature review and guideline recommendations
Yong-Hwan CHO ; Jaehyung CHOI ; Chae-Wook HUH ; Chang Hyeun KIM ; Chul Hoon CHANG ; Soon Chan KWON ; Young Woo KIM ; Seung Hun SHEEN ; Sukh Que PARK ; Jun Kyeung KO ; Sung-kon HA ; Hae Woong JEONG ; Hyen Seung KANG ;
Journal of Cerebrovascular and Endovascular Neurosurgery 2025;27(1):80-80
10.Prediction of Hemifacial Spasm Re-Appearing Phenomenon after Microvascular Decompression Surgery in Patients with Hemifacial Spasm Using Dynamic Susceptibility Contrast Perfusion Magnetic Resonance Imaging
Seung Hoon LIM ; Xiao-Yi GUO ; Hyug-Gi KIM ; Hak Cheol KO ; Soonchan PARK ; Chang-Woo RYU ; Geon-Ho JAHNG
Journal of Korean Neurosurgical Society 2025;68(1):46-59
Objective:
: Hemifacial spasm (HFS) is treated by a surgical procedure called microvascular decompression (MVD). However, HFS re-appearing phenomenon after surgery, presenting as early recurrence, is experienced by some patients after MVD. Dynamic susceptibility contrast (DSC) perfusion magnetic resonance imaging (MRI) and two analytical methods : receiver operating characteristic (ROC) curve and machine learning, were used to predict early recurrence in this study.
Methods:
: This study enrolled 60 patients who underwent MVD for HFS. They were divided into two groups : group A consisted of 32 patients who had early recurrence and group B consisted of 28 patients who had no early recurrence of HFS. DSC perfusion MRI was undergone by all patients before the surgery to obtain the several parameters. ROC curve and machine learning methods were used to predict early recurrence using these parameters.
Results:
: Group A had significantly lower relative cerebral blood flow than group B in most of the selected brain regions, as shown by the region-of-interest-based analysis. By combining three extraction fraction (EF) values at middle temporal gyrus, posterior cingulate, and brainstem, with age, using naive Bayes machine learning method, the best prediction model for early recurrence was obtained. This model had an area under the curve value of 0.845.
Conclusion
: By combining EF values with age or sex using machine learning methods, DSC perfusion MRI can be used to predict early recurrence before MVD surgery. This may help neurosurgeons to identify patients who are at risk of HFS recurrence and provide appropriate postoperative care.

Result Analysis
Print
Save
E-mail