1.Evaluating the Accuracy and Diagnostic Reasoning of Multimodal Large Language Models in Interpreting Neuroradiology Cases From RadioGraphics
Pae Sun SUH ; Ji Su KO ; Woo Hyun SHIM ; Hwon HEO ; Chang-Yun WOO ; Hyungjun PARK ; Chong Hyun SUH
Korean Journal of Radiology 2026;27(3):214-226
Objective:
To evaluate the accuracy and reasoning capabilities of large multimodal language models compared with those of neuroradiology subspecialty-trained radiologists in neuroradiology case interpretation.
Materials and Methods:
This experimental study used custom-made 401 radiologic quizzes derived from articles published in RadioGraphics covering neuroradiology and head and neck topics (October 2020 to February 2024). We prompted the GPT-4 Turbo with Vision (GPT-4V), GPT-4 Omni, Gemini Flash, and Claude models to provide the top three differential diagnoses with a rationale and describe examination characteristics such as imaging modality, sequence, use of contrast, image plane, and body part. The temperature was adjusted to 0 and 1 (T1). Two neuroradiologists answered the same questions.The accuracies of the large language models (LLMs) and the neuroradiologists were compared using generalized estimating equations. Three neuroradiologists assessed the rationale provided by the LLMs for their differential diagnoses using four-point scales, separately for specific lesion locations and imaging findings, and evaluated the presence of hallucinations and the overall acceptability of the responses.
Results:
Top-3 accuracy (i.e., correct answers present among top-3 differential diagnoses) of LLMs ranged from 29.9% (120 of 401) to 49.4% (198 of 401, obtained with GPT-4V in the T1 setting), while radiologists achieved 80.3% (322 of 401) and 68.3% (274 of 401), respectively (P < 0.001). Regarding the rationale for differential diagnoses, GPT-4V (T1) accurately identified both the specific lesion location and imaging findings in 30.7% (123 of 401) and 12.9% (16 of 124) of cases without textual clinical history. Hallucinations occurred in 4.5% (18 of 401), and only 29.4% (118 of 401) of the LLM-generated analyses were deemed acceptable. GPT-4V (T1) demonstrated high accuracy in identifying the imaging modality (97.4% [800 of 821]) and scanned body parts (92.2% [756 of 820]).
Conclusion
LLMs remarkably underperformed compared with neuroradiologists and showed unsatisfactory reasoning for their differential diagnoses, with performance declining further in cases without textual input of clinical history. These findings highlight the limitations of current multimodal LLMs in neuroradiological interpretation and their reliance on text input.
3.Long-term Immunogenicity of the 13-valent Pneumococcal Conjugate Vaccine during Adjuvant Chemotherapy in Patients with Gastric and Colorectal Cancer: A 5-Year Follow-up of a Randomized Controlled Trial
Hyeon-Jong KIM ; Hyunjin BANG ; Hyun-Jung SHIM ; Jun Eul HWANG ; Sang-Hee CHO ; Ik-Joo CHUNG ; Seung Ji KANG ; Jong Gwang KIM ; Seung-Hoon BEOM ; A-Yeung JANG ; Joon Young SONG ; Woo Kyun BAE
Cancer Research and Treatment 2026;58(1):61-70
Purpose:
Current guidelines recommend vaccination at least 2 weeks before chemotherapy initiation to optimize the immune response despite limited evidence. Our previous study indicated no differences in short-term immune response for the 13-valent pneumococcal conjugate vaccine (PCV13) according to the vaccination timing. This study aims to investigate the long-term efficacy of PCV13 and clinical factors associated with the respective antibody response.
Materials and Methods:
Patients with gastric or colorectal cancer who received adjuvant chemotherapy were enrolled and divided into two groups: vaccinated 2 weeks before chemotherapy (arm A) and vaccinated concurrently with chemotherapy (arm B). Serum samples were collected before vaccination and in one month, 3 years, and 5 years. Immune responses were measured using enzyme-linked immunosorbent assay and multiplex opsonophagocytosis assay.
Results:
Including 63 patients, both groups showed an initial increase in the geometric mean titers of opsonophagocytic activity and the geometric mean concentrations of serotype-specific IgG levels after one month, followed by a decline at 3 and 5 years, particularly for serotypes 1, 14, 18C, and 19A. Despite the decline, global protection was maintained for 5 years, although global response decreased. The two arms did not show significant differences in immunogenicity nor in factors such as vaccination timing, age, cancer type, or chemotherapy regimen.
Conclusion
Vaccination timing is not a significant factor for the immunogenicity of PCV13 in cancer patients undergoing adjuvant chemotherapy. Global protection against pneumococcal infection was sustained for > 5 years, and global response remained in over half of patients.
4.Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist
Ji Su KO ; Hwon HEO ; Chong Hyun SUH ; Jeho YI ; Woo Hyun SHIM
Korean Journal of Radiology 2025;26(4):304-312
Objective:
To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.
Materials and Methods:
A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data—were independently extracted by two reviewers, and adherence was calculated for each item.
Results:
Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.
Conclusion
Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
5.Licochalcone D Exerts Antitumor Activity in Human Colorectal Cancer Cells by Inducing ROS Generation and Phosphorylating JNK and p38 MAPK
Seung-On LEE ; Sang Hoon JOO ; Seung-Sik CHO ; Goo YOON ; Yung Hyun CHOI ; Jin Woo PARK ; Kwon-Yeon WEON ; Jung-Hyun SHIM
Biomolecules & Therapeutics 2025;33(2):344-354
Anticancer activities of Licochalcone D (LCD) in human colorectal cancer (CRC) cells HCT116 and oxaliplatin-resistant HCT116 (HCT116-OxR) were determined. Cell viability assay and soft agar assay were used to analyze antiproliferative activity of LCD.Flow cytometry was performed to determine effects of LCD on apoptosis, cell cycle distribution, reactive oxygen species (ROS), mitochondrial membrane potential (MMP) dysfunction, and multi-caspase activity in CRC cells. Western blot analysis was used to monitor levels of proteins involved in cell cycle and apoptosis signaling pathways. LCD suppressed the growth and anchorageindependent colony formation of both HCT116 and HCT116-OxR cells. Cell cycle analysis by flow cytometry indicated that LCD induced cell cycle arrest and increased cells in sub-G1 phase. In parallel with the antiproliferative effect of LCD, LCD up-regulated levels of p21 and p27 while downregulating cyclin B1 and cdc2. In addition, phosphorylation levels of JNK and p38 mitogen-activated protein kinase (MAPK) were increased by LCD. Inhibition of these kinases somehow prevented the antiproliferative effect of LCD. Moreover, LCD increased ROS and deregulated mitochondrial membrane potential, leading to the activation of multiple caspases. An ROS scavenger N-acetyl-cysteine (NAC) or pan-caspase inhibitor Z-VAD-FMK prevented the antiproliferative effect of LCD, supporting that ROS generation and caspase activation mediated LCD-induced apoptosis in CRC cells. In conclusion, LCD exerted antitumor activity in CRC cells by inducing ROS generation and phosphorylation of JNK and p38 MAPK. These results support that LCD could be further developed as a chemotherapeutic agent for treating CRC.
6.Effectiveness of Buspirone in Alleviating Anxiety Symptoms in Patients with Depressive Disorder: A Multicenter Prospective Observational Study in Korea
Young Sup WOO ; Won-Seok CHOI ; Jong-Hyun JEONG ; Jonghun LEE ; Do-Hoon KIM ; Jong-Chul YANG ; Se-Hoon SHIM ; Seung-Gul KANG ; Young-Eun JUNG ; Won KIM ; Chi-Un PAE ; Won-Myong BAHK
Clinical Psychopharmacology and Neuroscience 2025;23(1):144-154
Objective:
We aimed to investigate the effectiveness of buspirone as an adjunctive therapy for alleviating anxiety symptoms in patients with depressive disorders who are already taking antidepressants.
Methods:
This was an open-label prospective multicenter non-interventional observational study conducted over 12 weeks. We enrolled 180 patients diagnosed with depressive disorders according to DSM-5 criteria and Hamilton Anxiety Rating Scale (HAMA) scores ≥ 18. Participants were already taking selective serotonin reuptake inhibitors or serotoninnorepinephrine reuptake inhibitors and were prescribed adjunctive buspirone. Efficacy was assessed using HAMA, Hamilton Depression Rating Scale (HAMD), Clinical Global Impression Scale-Improvement, Clinical Global Impression Scale-Severity, Sheehan Disability Scale (SDS), and WHO-5 Well-Being Index.
Results:
The efficacy analysis included 161 patients. HAMA scores decreased significantly from 25.2 ± 6.7 at baseline to 15.4 ± 8.6 at 12 weeks (p < 0.001), whereas HAMD scores decreased from 19.4 ± 4.6 to 12.7 ± 5.7 (p < 0.001).WHO-5 and SDS scores showed significant improvements. The HAMA response rate was 39.1% and the remission rate was 13.7% at 12 weeks. Adverse drug reactions were reported in 3.7% of participants. Subgroup analyses showed no significant differences in treatment response based on buspirone dosage, baseline anxiety/depression severity, or benzodiazepine use.
Conclusion
Adjunctive buspirone therapy effectively improved anxiety symptoms in depressed patients taking antidepressants, regardless of baseline symptom severity or buspirone dosage. The treatment was well-tolerated with few adverse events. Future studies using a control group are needed.
7.Clinical Practice Guidelines for Dementia: Recommendations for Cholinesterase Inhibitors and Memantine
Yeshin KIM ; Dong Woo KANG ; Geon Ha KIM ; Ko Woon KIM ; Hee-Jin KIM ; Seunghee NA ; Kee Hyung PARK ; Young Ho PARK ; Gihwan BYEON ; Jeewon SUH ; Joon Hyun SHIN ; YongSoo SHIM ; YoungSoon YANG ; Yoo Hyun UM ; Seong-il OH ; Sheng-Min WANG ; Bora YOON ; Sun Min LEE ; Juyoun LEE ; Jin San LEE ; Jae-Sung LIM ; Young Hee JUNG ; Juhee CHIN ; Hyemin JANG ; Miyoung CHOI ; Yun Jeong HONG ; Hak Young RHEE ; Jae-Won JANG ;
Dementia and Neurocognitive Disorders 2025;24(1):1-23
Background:
and Purpose: This clinical practice guideline provides evidence-based recommendations for treatment of dementia, focusing on cholinesterase inhibitors and N-methyl-D-aspartate (NMDA) receptor antagonists for Alzheimer’s disease (AD) and other types of dementia.
Methods:
Using the Population, Intervention, Comparison, Outcomes (PICO) framework, we developed key clinical questions and conducted systematic literature reviews. A multidisciplinary panel of experts, organized by the Korean Dementia Association, evaluated randomized controlled trials and observational studies. Recommendations were graded for evidence quality and strength using Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) methodology.
Results:
Three main recommendations are presented: (1) For AD, cholinesterase inhibitors (donepezil, rivastigmine, galantamine) are strongly recommended for improving cognition and daily function based on moderate evidence; (2) Cholinesterase inhibitors are conditionally recommended for vascular dementia and Parkinson’s disease dementia, with a strong recommendation for Lewy body dementia; (3) For moderate to severe AD, NMDA receptor antagonist (memantine) is strongly recommended, demonstrating significant cognitive and functional improvements. Both drug classes showed favorable safety profiles with manageable side effects.
Conclusions
This guideline offers standardized, evidence-based pharmacologic recommendations for dementia management, with specific guidance on cholinesterase inhibitors and NMDA receptor antagonists. It aims to support clinical decision-making and improve patient outcomes in dementia care. Further updates will address emerging treatments, including amyloid-targeting therapies, to reflect advances in dementia management.
8.Licochalcone D Exerts Antitumor Activity in Human Colorectal Cancer Cells by Inducing ROS Generation and Phosphorylating JNK and p38 MAPK
Seung-On LEE ; Sang Hoon JOO ; Seung-Sik CHO ; Goo YOON ; Yung Hyun CHOI ; Jin Woo PARK ; Kwon-Yeon WEON ; Jung-Hyun SHIM
Biomolecules & Therapeutics 2025;33(2):344-354
Anticancer activities of Licochalcone D (LCD) in human colorectal cancer (CRC) cells HCT116 and oxaliplatin-resistant HCT116 (HCT116-OxR) were determined. Cell viability assay and soft agar assay were used to analyze antiproliferative activity of LCD.Flow cytometry was performed to determine effects of LCD on apoptosis, cell cycle distribution, reactive oxygen species (ROS), mitochondrial membrane potential (MMP) dysfunction, and multi-caspase activity in CRC cells. Western blot analysis was used to monitor levels of proteins involved in cell cycle and apoptosis signaling pathways. LCD suppressed the growth and anchorageindependent colony formation of both HCT116 and HCT116-OxR cells. Cell cycle analysis by flow cytometry indicated that LCD induced cell cycle arrest and increased cells in sub-G1 phase. In parallel with the antiproliferative effect of LCD, LCD up-regulated levels of p21 and p27 while downregulating cyclin B1 and cdc2. In addition, phosphorylation levels of JNK and p38 mitogen-activated protein kinase (MAPK) were increased by LCD. Inhibition of these kinases somehow prevented the antiproliferative effect of LCD. Moreover, LCD increased ROS and deregulated mitochondrial membrane potential, leading to the activation of multiple caspases. An ROS scavenger N-acetyl-cysteine (NAC) or pan-caspase inhibitor Z-VAD-FMK prevented the antiproliferative effect of LCD, supporting that ROS generation and caspase activation mediated LCD-induced apoptosis in CRC cells. In conclusion, LCD exerted antitumor activity in CRC cells by inducing ROS generation and phosphorylation of JNK and p38 MAPK. These results support that LCD could be further developed as a chemotherapeutic agent for treating CRC.
9.Effectiveness of Buspirone in Alleviating Anxiety Symptoms in Patients with Depressive Disorder: A Multicenter Prospective Observational Study in Korea
Young Sup WOO ; Won-Seok CHOI ; Jong-Hyun JEONG ; Jonghun LEE ; Do-Hoon KIM ; Jong-Chul YANG ; Se-Hoon SHIM ; Seung-Gul KANG ; Young-Eun JUNG ; Won KIM ; Chi-Un PAE ; Won-Myong BAHK
Clinical Psychopharmacology and Neuroscience 2025;23(1):144-154
Objective:
We aimed to investigate the effectiveness of buspirone as an adjunctive therapy for alleviating anxiety symptoms in patients with depressive disorders who are already taking antidepressants.
Methods:
This was an open-label prospective multicenter non-interventional observational study conducted over 12 weeks. We enrolled 180 patients diagnosed with depressive disorders according to DSM-5 criteria and Hamilton Anxiety Rating Scale (HAMA) scores ≥ 18. Participants were already taking selective serotonin reuptake inhibitors or serotoninnorepinephrine reuptake inhibitors and were prescribed adjunctive buspirone. Efficacy was assessed using HAMA, Hamilton Depression Rating Scale (HAMD), Clinical Global Impression Scale-Improvement, Clinical Global Impression Scale-Severity, Sheehan Disability Scale (SDS), and WHO-5 Well-Being Index.
Results:
The efficacy analysis included 161 patients. HAMA scores decreased significantly from 25.2 ± 6.7 at baseline to 15.4 ± 8.6 at 12 weeks (p < 0.001), whereas HAMD scores decreased from 19.4 ± 4.6 to 12.7 ± 5.7 (p < 0.001).WHO-5 and SDS scores showed significant improvements. The HAMA response rate was 39.1% and the remission rate was 13.7% at 12 weeks. Adverse drug reactions were reported in 3.7% of participants. Subgroup analyses showed no significant differences in treatment response based on buspirone dosage, baseline anxiety/depression severity, or benzodiazepine use.
Conclusion
Adjunctive buspirone therapy effectively improved anxiety symptoms in depressed patients taking antidepressants, regardless of baseline symptom severity or buspirone dosage. The treatment was well-tolerated with few adverse events. Future studies using a control group are needed.
10.Clinical Practice Guidelines for Dementia: Recommendations for Cholinesterase Inhibitors and Memantine
Yeshin KIM ; Dong Woo KANG ; Geon Ha KIM ; Ko Woon KIM ; Hee-Jin KIM ; Seunghee NA ; Kee Hyung PARK ; Young Ho PARK ; Gihwan BYEON ; Jeewon SUH ; Joon Hyun SHIN ; YongSoo SHIM ; YoungSoon YANG ; Yoo Hyun UM ; Seong-il OH ; Sheng-Min WANG ; Bora YOON ; Sun Min LEE ; Juyoun LEE ; Jin San LEE ; Jae-Sung LIM ; Young Hee JUNG ; Juhee CHIN ; Hyemin JANG ; Miyoung CHOI ; Yun Jeong HONG ; Hak Young RHEE ; Jae-Won JANG ;
Dementia and Neurocognitive Disorders 2025;24(1):1-23
Background:
and Purpose: This clinical practice guideline provides evidence-based recommendations for treatment of dementia, focusing on cholinesterase inhibitors and N-methyl-D-aspartate (NMDA) receptor antagonists for Alzheimer’s disease (AD) and other types of dementia.
Methods:
Using the Population, Intervention, Comparison, Outcomes (PICO) framework, we developed key clinical questions and conducted systematic literature reviews. A multidisciplinary panel of experts, organized by the Korean Dementia Association, evaluated randomized controlled trials and observational studies. Recommendations were graded for evidence quality and strength using Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) methodology.
Results:
Three main recommendations are presented: (1) For AD, cholinesterase inhibitors (donepezil, rivastigmine, galantamine) are strongly recommended for improving cognition and daily function based on moderate evidence; (2) Cholinesterase inhibitors are conditionally recommended for vascular dementia and Parkinson’s disease dementia, with a strong recommendation for Lewy body dementia; (3) For moderate to severe AD, NMDA receptor antagonist (memantine) is strongly recommended, demonstrating significant cognitive and functional improvements. Both drug classes showed favorable safety profiles with manageable side effects.
Conclusions
This guideline offers standardized, evidence-based pharmacologic recommendations for dementia management, with specific guidance on cholinesterase inhibitors and NMDA receptor antagonists. It aims to support clinical decision-making and improve patient outcomes in dementia care. Further updates will address emerging treatments, including amyloid-targeting therapies, to reflect advances in dementia management.

Result Analysis
Print
Save
E-mail