1.Evaluating the Accuracy and Diagnostic Reasoning of Multimodal Large Language Models in Interpreting Neuroradiology Cases From RadioGraphics
Pae Sun SUH ; Ji Su KO ; Woo Hyun SHIM ; Hwon HEO ; Chang-Yun WOO ; Hyungjun PARK ; Chong Hyun SUH
Korean Journal of Radiology 2026;27(3):214-226
Objective:
To evaluate the accuracy and reasoning capabilities of large multimodal language models compared with those of neuroradiology subspecialty-trained radiologists in neuroradiology case interpretation.
Materials and Methods:
This experimental study used custom-made 401 radiologic quizzes derived from articles published in RadioGraphics covering neuroradiology and head and neck topics (October 2020 to February 2024). We prompted the GPT-4 Turbo with Vision (GPT-4V), GPT-4 Omni, Gemini Flash, and Claude models to provide the top three differential diagnoses with a rationale and describe examination characteristics such as imaging modality, sequence, use of contrast, image plane, and body part. The temperature was adjusted to 0 and 1 (T1). Two neuroradiologists answered the same questions.The accuracies of the large language models (LLMs) and the neuroradiologists were compared using generalized estimating equations. Three neuroradiologists assessed the rationale provided by the LLMs for their differential diagnoses using four-point scales, separately for specific lesion locations and imaging findings, and evaluated the presence of hallucinations and the overall acceptability of the responses.
Results:
Top-3 accuracy (i.e., correct answers present among top-3 differential diagnoses) of LLMs ranged from 29.9% (120 of 401) to 49.4% (198 of 401, obtained with GPT-4V in the T1 setting), while radiologists achieved 80.3% (322 of 401) and 68.3% (274 of 401), respectively (P < 0.001). Regarding the rationale for differential diagnoses, GPT-4V (T1) accurately identified both the specific lesion location and imaging findings in 30.7% (123 of 401) and 12.9% (16 of 124) of cases without textual clinical history. Hallucinations occurred in 4.5% (18 of 401), and only 29.4% (118 of 401) of the LLM-generated analyses were deemed acceptable. GPT-4V (T1) demonstrated high accuracy in identifying the imaging modality (97.4% [800 of 821]) and scanned body parts (92.2% [756 of 820]).
Conclusion
LLMs remarkably underperformed compared with neuroradiologists and showed unsatisfactory reasoning for their differential diagnoses, with performance declining further in cases without textual input of clinical history. These findings highlight the limitations of current multimodal LLMs in neuroradiological interpretation and their reliance on text input.
3.Combination Therapy with Betulinic Acid and TRAIL Increases ROS-Dependent Cytotoxicity and Inhibits PI3K/Akt Signaling in Human Bladder Cancer Cells
Cheol PARK ; Hee-Jae CHA ; Su Hyun HONG ; Heui-Soo KIM ; Sun-Hee LEEM ; Jung-Hyun SHIM ; Gi-Young KIM ; Kyoung Ah KANG ; Jin Won HYUN ; Yung Hyun CHOI
Biomolecules & Therapeutics 2026;34(3):641-651
Tumor necrosis factor-related apoptosis-inducing ligand (TRAIL) is a cytokine that selectively targets cancer cells and induces apoptosis. However, many cancers, including bladder cancer, develop resistance to TRAIL, limiting the efficacy of TRAIL-based therapies. This study investigated whether betulinic acid (BA), a pentacyclic triterpenoid with anticancer and chemosensitizing properties, increases TRAIL-mediated apoptosis in TRAIL-resistant human bladder cancer cells. Combination treatment with BA and TRAIL significantly increased cytotoxicity and apoptosis compared to either treatment alone. This combination treatment also increased reactive oxygen species (ROS) production, increased Bax expression and Bid cleavage (tBid formation), and downregulated Bcl-2 levels. These effects were accompanied by caspase activation via extrinsic and intrinsic pathways, leading to cytochrome c release via mitochondrial membrane destabilization, thereby contributing to increased apoptosis. Furthermore, the combination treatment inhibited phosphoinositide 3-kinase (PI3K) and Akt phosphorylation; this effect was amplified by a PI3K inhibitor but abrogated by ROS inhibition. Collectively, our results suggest that BA sensitizes bladder cancer cells to TRAILinduced apoptosis via ROS-dependent activation of the apoptotic pathway and inhibition of PI3K/Akt signaling. Therefore, the BA and TRAIL combination exhibits potential to overcome TRAIL resistance in human bladder cancer.
4.Paeoniflorin Protects Retinal Pigment Epithelial Cells from High Glucose-Induced Oxidative Damage by Activating Nrf2-Mediated HO-1 Signaling
Cheol PARK ; Hee-Jae CHA ; Su Hyun HONG ; Jeong Sook NOH ; Sang Hoon HONG ; Gi Young KIM ; Jung-Hyun SHIM ; Jin Won HYUN ; Yung Hyun CHOI
Biomolecules & Therapeutics 2025;33(3):518-528
Oxidative stress due to hyperglycemia damages the functions of retinal pigment epithelial (RPE) cells and is a major risk factor for diabetic retinopathy (DR). Paeoniflorin is a monoterpenoid glycoside found in the roots of Paeonia lactiflora Pall and has been reported to have a variety of health benefits. However, the mechanisms underlying its therapeutic effects on high glucose (HG)-induced oxidative damage in RPE cells are not fully understood. In this study, we investigated the protective effect of paeoniflorin against HG-induced oxidative damage in cultured human RPE ARPE-19 cells, an in vitro model of hyperglycemia. Pretreatment with paeoniflorin markedly reduced HG-induced cytotoxicity and DNA damage. Paeoniflorin inhibited HG-induced apoptosis by suppressing activation of the caspase cascade, and this suppression was associated with the blockade of cytochrome c release to cytoplasm by maintaining mitochondrial membrane stability. In addition, paeoniflorin suppressed the HG-induced production of reactive oxygen species (ROS), increased the phosphorylation of nuclear factor erythroid 2-related factor 2 (Nrf2), a key redox regulator, and the expression of its downstream factor heme oxygenase-1 (HO-1). On the other hand, zinc protoporphyrin (ZnPP), an inhibitor of HO-1, abolished the protective effect of paeoniflorin against ROS production in HG-treated cells. Furthermore, ZnPP reversed the protective effects of paeoniflorin against HG-induced cellular damage and induced mitochondrial damage, DNA injury, and apoptosis in paeoniflorin-treated cells. These results suggest that paeoniflorin protects RPE cells from HG-mediated oxidative stress-induced cytotoxicity by activating Nrf2/HO-1 signaling and highlight the potential therapeutic use of paeoniflorin to improve the symptoms of DR.
5.Cynaropicrin Induces Reactive Oxygen Species-Dependent Paraptosis-Like Cell Death in Human Liver Cancer Cells
Min Yeong KIM ; Hee-Jae CHA ; Su Hyun HONG ; Sung-Kwon MOON ; Taeg Kyu KWON ; Young-Chae CHANG ; Gi Young KIM ; Jin Won HYUN ; A-Young NAM ; Jung-Hyun SHIM ; Yung Hyun CHOI
Biomolecules & Therapeutics 2025;33(3):470-482
Cynaropicrin, a sesquiterpene lactone found in artichoke leaves exerts diverse pharmacological effects. This study investigated whether cynaropicrin has a paraptosis-like cell death effect in human hepatocellular carcinoma Hep3B cells in addition to the apoptotic effects reported in several cancer cell lines. Cynaropicrin-induced cytotoxicity and cytoplasmic vacuolation, a key characteristic of paraptosis, were not ameliorated by inhibitors of necroptosis, autophagy, or pan caspase inhibitors in Hep3B cells. Our study showed that cynaropicrin-induced cytotoxicity was accompanied by mitochondrial dysfunction and endoplasmic reticulum stress along with increased cellular calcium ion levels. These effects were significantly mitigated by endoplasmic reticulum stress inhibitor or protein synthesis inhibitor. Moreover, cynaropicrin treatment in Hep3B cells increased reactive oxygen species generation and downregulated apoptosis-linked gene 2-interacting protein X (Alix), a protein that inhibits paraptosis. The addition of the reactive oxygen species scavenger N-acetyl-L-cysteine (NAC) neutralized cynaropicrin-induced changes in Alix expression and endoplasmic reticulum stress marker proteins counteracting endoplasmic reticulum stress and mitochondrial impairment. This demonstrates a close relationship between endoplasmic reticulum stress and reactive oxygen species generation. Additionally, cynaropicrin activated p38 mitogen activated protein kinase and a selective p38 mitogen activated protein kinase blocker alleviated the biological phenomena induced by cynaropicrin. NAC pretreatment showed the best reversal of cynaropicrin induced vacuolation and cellular inactivity. Our findings suggest that cynaropicrin induced oxidative stress in Hep3B cells contributes to paraptotic events including endoplasmic reticulum stress and mitochondrial damage.
6.Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist
Ji Su KO ; Hwon HEO ; Chong Hyun SUH ; Jeho YI ; Woo Hyun SHIM
Korean Journal of Radiology 2025;26(4):304-312
Objective:
To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.
Materials and Methods:
A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data—were independently extracted by two reviewers, and adherence was calculated for each item.
Results:
Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.
Conclusion
Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
7.Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist
Ji Su KO ; Hwon HEO ; Chong Hyun SUH ; Jeho YI ; Woo Hyun SHIM
Korean Journal of Radiology 2025;26(4):304-312
Objective:
To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.
Materials and Methods:
A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data—were independently extracted by two reviewers, and adherence was calculated for each item.
Results:
Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.
Conclusion
Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
8.Paeoniflorin Protects Retinal Pigment Epithelial Cells from High Glucose-Induced Oxidative Damage by Activating Nrf2-Mediated HO-1 Signaling
Cheol PARK ; Hee-Jae CHA ; Su Hyun HONG ; Jeong Sook NOH ; Sang Hoon HONG ; Gi Young KIM ; Jung-Hyun SHIM ; Jin Won HYUN ; Yung Hyun CHOI
Biomolecules & Therapeutics 2025;33(3):518-528
Oxidative stress due to hyperglycemia damages the functions of retinal pigment epithelial (RPE) cells and is a major risk factor for diabetic retinopathy (DR). Paeoniflorin is a monoterpenoid glycoside found in the roots of Paeonia lactiflora Pall and has been reported to have a variety of health benefits. However, the mechanisms underlying its therapeutic effects on high glucose (HG)-induced oxidative damage in RPE cells are not fully understood. In this study, we investigated the protective effect of paeoniflorin against HG-induced oxidative damage in cultured human RPE ARPE-19 cells, an in vitro model of hyperglycemia. Pretreatment with paeoniflorin markedly reduced HG-induced cytotoxicity and DNA damage. Paeoniflorin inhibited HG-induced apoptosis by suppressing activation of the caspase cascade, and this suppression was associated with the blockade of cytochrome c release to cytoplasm by maintaining mitochondrial membrane stability. In addition, paeoniflorin suppressed the HG-induced production of reactive oxygen species (ROS), increased the phosphorylation of nuclear factor erythroid 2-related factor 2 (Nrf2), a key redox regulator, and the expression of its downstream factor heme oxygenase-1 (HO-1). On the other hand, zinc protoporphyrin (ZnPP), an inhibitor of HO-1, abolished the protective effect of paeoniflorin against ROS production in HG-treated cells. Furthermore, ZnPP reversed the protective effects of paeoniflorin against HG-induced cellular damage and induced mitochondrial damage, DNA injury, and apoptosis in paeoniflorin-treated cells. These results suggest that paeoniflorin protects RPE cells from HG-mediated oxidative stress-induced cytotoxicity by activating Nrf2/HO-1 signaling and highlight the potential therapeutic use of paeoniflorin to improve the symptoms of DR.
9.Cynaropicrin Induces Reactive Oxygen Species-Dependent Paraptosis-Like Cell Death in Human Liver Cancer Cells
Min Yeong KIM ; Hee-Jae CHA ; Su Hyun HONG ; Sung-Kwon MOON ; Taeg Kyu KWON ; Young-Chae CHANG ; Gi Young KIM ; Jin Won HYUN ; A-Young NAM ; Jung-Hyun SHIM ; Yung Hyun CHOI
Biomolecules & Therapeutics 2025;33(3):470-482
Cynaropicrin, a sesquiterpene lactone found in artichoke leaves exerts diverse pharmacological effects. This study investigated whether cynaropicrin has a paraptosis-like cell death effect in human hepatocellular carcinoma Hep3B cells in addition to the apoptotic effects reported in several cancer cell lines. Cynaropicrin-induced cytotoxicity and cytoplasmic vacuolation, a key characteristic of paraptosis, were not ameliorated by inhibitors of necroptosis, autophagy, or pan caspase inhibitors in Hep3B cells. Our study showed that cynaropicrin-induced cytotoxicity was accompanied by mitochondrial dysfunction and endoplasmic reticulum stress along with increased cellular calcium ion levels. These effects were significantly mitigated by endoplasmic reticulum stress inhibitor or protein synthesis inhibitor. Moreover, cynaropicrin treatment in Hep3B cells increased reactive oxygen species generation and downregulated apoptosis-linked gene 2-interacting protein X (Alix), a protein that inhibits paraptosis. The addition of the reactive oxygen species scavenger N-acetyl-L-cysteine (NAC) neutralized cynaropicrin-induced changes in Alix expression and endoplasmic reticulum stress marker proteins counteracting endoplasmic reticulum stress and mitochondrial impairment. This demonstrates a close relationship between endoplasmic reticulum stress and reactive oxygen species generation. Additionally, cynaropicrin activated p38 mitogen activated protein kinase and a selective p38 mitogen activated protein kinase blocker alleviated the biological phenomena induced by cynaropicrin. NAC pretreatment showed the best reversal of cynaropicrin induced vacuolation and cellular inactivity. Our findings suggest that cynaropicrin induced oxidative stress in Hep3B cells contributes to paraptotic events including endoplasmic reticulum stress and mitochondrial damage.
10.Paeoniflorin Protects Retinal Pigment Epithelial Cells from High Glucose-Induced Oxidative Damage by Activating Nrf2-Mediated HO-1 Signaling
Cheol PARK ; Hee-Jae CHA ; Su Hyun HONG ; Jeong Sook NOH ; Sang Hoon HONG ; Gi Young KIM ; Jung-Hyun SHIM ; Jin Won HYUN ; Yung Hyun CHOI
Biomolecules & Therapeutics 2025;33(3):518-528
Oxidative stress due to hyperglycemia damages the functions of retinal pigment epithelial (RPE) cells and is a major risk factor for diabetic retinopathy (DR). Paeoniflorin is a monoterpenoid glycoside found in the roots of Paeonia lactiflora Pall and has been reported to have a variety of health benefits. However, the mechanisms underlying its therapeutic effects on high glucose (HG)-induced oxidative damage in RPE cells are not fully understood. In this study, we investigated the protective effect of paeoniflorin against HG-induced oxidative damage in cultured human RPE ARPE-19 cells, an in vitro model of hyperglycemia. Pretreatment with paeoniflorin markedly reduced HG-induced cytotoxicity and DNA damage. Paeoniflorin inhibited HG-induced apoptosis by suppressing activation of the caspase cascade, and this suppression was associated with the blockade of cytochrome c release to cytoplasm by maintaining mitochondrial membrane stability. In addition, paeoniflorin suppressed the HG-induced production of reactive oxygen species (ROS), increased the phosphorylation of nuclear factor erythroid 2-related factor 2 (Nrf2), a key redox regulator, and the expression of its downstream factor heme oxygenase-1 (HO-1). On the other hand, zinc protoporphyrin (ZnPP), an inhibitor of HO-1, abolished the protective effect of paeoniflorin against ROS production in HG-treated cells. Furthermore, ZnPP reversed the protective effects of paeoniflorin against HG-induced cellular damage and induced mitochondrial damage, DNA injury, and apoptosis in paeoniflorin-treated cells. These results suggest that paeoniflorin protects RPE cells from HG-mediated oxidative stress-induced cytotoxicity by activating Nrf2/HO-1 signaling and highlight the potential therapeutic use of paeoniflorin to improve the symptoms of DR.

Result Analysis
Print
Save
E-mail