1.Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist
Ji Su KO ; Hwon HEO ; Chong Hyun SUH ; Jeho YI ; Woo Hyun SHIM
Korean Journal of Radiology 2025;26(4):304-312
Objective:
To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.
Materials and Methods:
A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data—were independently extracted by two reviewers, and adherence was calculated for each item.
Results:
Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.
Conclusion
Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
2.Changing Gadolinium-Based Contrast Agents to Prevent Recurrent Acute Adverse Drug Reactions: 6-Year Cohort Study Using Propensity Score Matching
Min Woo HAN ; Chong Hyun SUH ; Pyeong Hwa KIM ; Seonok KIM ; Ah Young KIM ; Kyung-Hyun DO ; Jeong Hyun LEE ; Dong-Il GWON ; Ah Young JUNG ; Choong Wook LEE
Korean Journal of Radiology 2025;26(2):204-204
3.Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist
Ji Su KO ; Hwon HEO ; Chong Hyun SUH ; Jeho YI ; Woo Hyun SHIM
Korean Journal of Radiology 2025;26(4):304-312
Objective:
To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.
Materials and Methods:
A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data—were independently extracted by two reviewers, and adherence was calculated for each item.
Results:
Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.
Conclusion
Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
4.Changing Gadolinium-Based Contrast Agents to Prevent Recurrent Acute Adverse Drug Reactions: 6-Year Cohort Study Using Propensity Score Matching
Min Woo HAN ; Chong Hyun SUH ; Pyeong Hwa KIM ; Seonok KIM ; Ah Young KIM ; Kyung-Hyun DO ; Jeong Hyun LEE ; Dong-Il GWON ; Ah Young JUNG ; Choong Wook LEE
Korean Journal of Radiology 2025;26(2):204-204
5.Clinical Practice Guidelines for Dementia: Recommendations for Cholinesterase Inhibitors and Memantine
Yeshin KIM ; Dong Woo KANG ; Geon Ha KIM ; Ko Woon KIM ; Hee-Jin KIM ; Seunghee NA ; Kee Hyung PARK ; Young Ho PARK ; Gihwan BYEON ; Jeewon SUH ; Joon Hyun SHIN ; YongSoo SHIM ; YoungSoon YANG ; Yoo Hyun UM ; Seong-il OH ; Sheng-Min WANG ; Bora YOON ; Sun Min LEE ; Juyoun LEE ; Jin San LEE ; Jae-Sung LIM ; Young Hee JUNG ; Juhee CHIN ; Hyemin JANG ; Miyoung CHOI ; Yun Jeong HONG ; Hak Young RHEE ; Jae-Won JANG ;
Dementia and Neurocognitive Disorders 2025;24(1):1-23
Background:
and Purpose: This clinical practice guideline provides evidence-based recommendations for treatment of dementia, focusing on cholinesterase inhibitors and N-methyl-D-aspartate (NMDA) receptor antagonists for Alzheimer’s disease (AD) and other types of dementia.
Methods:
Using the Population, Intervention, Comparison, Outcomes (PICO) framework, we developed key clinical questions and conducted systematic literature reviews. A multidisciplinary panel of experts, organized by the Korean Dementia Association, evaluated randomized controlled trials and observational studies. Recommendations were graded for evidence quality and strength using Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) methodology.
Results:
Three main recommendations are presented: (1) For AD, cholinesterase inhibitors (donepezil, rivastigmine, galantamine) are strongly recommended for improving cognition and daily function based on moderate evidence; (2) Cholinesterase inhibitors are conditionally recommended for vascular dementia and Parkinson’s disease dementia, with a strong recommendation for Lewy body dementia; (3) For moderate to severe AD, NMDA receptor antagonist (memantine) is strongly recommended, demonstrating significant cognitive and functional improvements. Both drug classes showed favorable safety profiles with manageable side effects.
Conclusions
This guideline offers standardized, evidence-based pharmacologic recommendations for dementia management, with specific guidance on cholinesterase inhibitors and NMDA receptor antagonists. It aims to support clinical decision-making and improve patient outcomes in dementia care. Further updates will address emerging treatments, including amyloid-targeting therapies, to reflect advances in dementia management.
6.Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist
Ji Su KO ; Hwon HEO ; Chong Hyun SUH ; Jeho YI ; Woo Hyun SHIM
Korean Journal of Radiology 2025;26(4):304-312
Objective:
To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.
Materials and Methods:
A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data—were independently extracted by two reviewers, and adherence was calculated for each item.
Results:
Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.
Conclusion
Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
7.Changing Gadolinium-Based Contrast Agents to Prevent Recurrent Acute Adverse Drug Reactions: 6-Year Cohort Study Using Propensity Score Matching
Min Woo HAN ; Chong Hyun SUH ; Pyeong Hwa KIM ; Seonok KIM ; Ah Young KIM ; Kyung-Hyun DO ; Jeong Hyun LEE ; Dong-Il GWON ; Ah Young JUNG ; Choong Wook LEE
Korean Journal of Radiology 2025;26(2):204-204
8.Profiling of Anti-Signal-Recognition Particle Antibodies and Clinical Characteristics in South Korean Patients With Immune-Mediated Necrotizing Myopathy
Soo-Hyun KIM ; Yunjung CHOI ; Eun Kyoung OH ; Ichizo NISHINO ; Shigeaki SUZUKI ; Bum Chun SUH ; Ha Young SHIN ; Seung Woo KIM ; Byeol-A YOON ; Seong-il OH ; Yoo Hwan KIM ; Hyunjin KIM ; Young-Min LIM ; Seol-Hee BAEK ; Je-Young SHIN ; Hung Youl SEOK ; Seung-Ah LEE ; Young-Chul CHOI ; Hyung Jun PARK
Journal of Clinical Neurology 2025;21(1):31-39
Background:
and Purpose This study evaluated the diagnostic utility of an anti-signal-recognition particle 54 (anti-SRP54) antibody-based enzyme-linked immunosorbent assay (ELISA) as well as the clinical, serological, and pathological characteristics of patients with SRP immune-mediated necrotizing myopathy (IMNM).
Methods:
We evaluated 87 patients with idiopathic inflammatory myopathy and 107 healthy participants between January 2002 and December 2023. The sensitivity and specificity of the ELISA for anti-SRP54 antibodies were assessed, and the clinical profiles of patients with antiSRP54 antibodies were determined.
Results:
The ELISA for anti-SRP54 antibodies had a sensitivity and specificity of 88% and 99%, respectively, along with a test–retest reliability of 0.92 (p<0.001). The 32 patients diagnosed with anti-SRP IMNM using a line-blot immunoassay included 28 (88%) who tested positive for anti-SRP54 antibodies using the ELISA, comprising 12 (43%) males and 16 (57%) females whose median ages at symptom onset and diagnosis were 43.0 years and 43.5 years, respectively. Symptoms included proximal muscle weakness in all 28 (100%) patients, neck weakness in 9 (32%), myalgia in 15 (54%), dysphagia in 5 (18%), dyspnea in 4 (14%), dysarthria in 2 (7%), interstitial lung disease in 2 (7%), and myocarditis in 2 (7%). The median serum creatine kinase (CK) level was 7,261 U/L (interquartile range: 5,086–10,007 U/L), and the median anti-SRP54 antibody level was 2.0 U/mL (interquartile range: 1.0–5.6 U/mL). The serum CK level was significantly higher in patients with coexisting anti-Ro-52 antibodies.
Conclusions
This study has confirmed the reliability of the ELISA for anti-SRP54 antibodies and provided insights into the clinical, serological, and pathological characteristics of South Korean patients with anti-SRP IMNM.
9.Clinical practice guidelines for uterine corpus cancer: an update to the Korean Society of Gynecologic Oncology guidelines
Woo Yeon HWANG ; Ju-Hyun KIM ; Joseph J. NOH ; Min-Hyun BAEK ; Min Chul CHOI ; Yong Jae LEE ; Maria LEE ; Dong Hoon SUH ; Yong Beom KIM ; Dae-Yeon KIM
Journal of Gynecologic Oncology 2025;36(1):e71-
The Korean Society of Gynecologic Oncology has updated its clinical practice guidelines for endometrial cancer to incorporate advancements in recent high-quality randomized controlled trials. These guidelines address evolving treatment paradigms, and are tailored to the Korean medical context. Key updates include a strong recommendation for doxorubicin/trabectedin combination therapy in metastatic or recurrent unresectable leiomyosarcoma based on the significant survival benefits demonstrated in a randomized controlled trial. For advanced or recurrent endometrial cancer, immune checkpoint inhibitors combined with chemotherapy have received strong recommendations, owing to their proven efficacy and increased accessibility in Korea. Conditional recommendations were made for combination therapies involving durvalumab and olaparib, reflecting their potential benefits, but acknowledging regulatory and accessibility constraints. These guidelines aim to provide evidence-based, practical strategies to optimize care for patients with endometrial cancer while addressing unmet clinical needs and adapting global advancements to Korea’s healthcare environment.
10.Clinical Practice Guidelines for Dementia: Recommendations for Cholinesterase Inhibitors and Memantine
Yeshin KIM ; Dong Woo KANG ; Geon Ha KIM ; Ko Woon KIM ; Hee-Jin KIM ; Seunghee NA ; Kee Hyung PARK ; Young Ho PARK ; Gihwan BYEON ; Jeewon SUH ; Joon Hyun SHIN ; YongSoo SHIM ; YoungSoon YANG ; Yoo Hyun UM ; Seong-il OH ; Sheng-Min WANG ; Bora YOON ; Sun Min LEE ; Juyoun LEE ; Jin San LEE ; Jae-Sung LIM ; Young Hee JUNG ; Juhee CHIN ; Hyemin JANG ; Miyoung CHOI ; Yun Jeong HONG ; Hak Young RHEE ; Jae-Won JANG ;
Dementia and Neurocognitive Disorders 2025;24(1):1-23
Background:
and Purpose: This clinical practice guideline provides evidence-based recommendations for treatment of dementia, focusing on cholinesterase inhibitors and N-methyl-D-aspartate (NMDA) receptor antagonists for Alzheimer’s disease (AD) and other types of dementia.
Methods:
Using the Population, Intervention, Comparison, Outcomes (PICO) framework, we developed key clinical questions and conducted systematic literature reviews. A multidisciplinary panel of experts, organized by the Korean Dementia Association, evaluated randomized controlled trials and observational studies. Recommendations were graded for evidence quality and strength using Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) methodology.
Results:
Three main recommendations are presented: (1) For AD, cholinesterase inhibitors (donepezil, rivastigmine, galantamine) are strongly recommended for improving cognition and daily function based on moderate evidence; (2) Cholinesterase inhibitors are conditionally recommended for vascular dementia and Parkinson’s disease dementia, with a strong recommendation for Lewy body dementia; (3) For moderate to severe AD, NMDA receptor antagonist (memantine) is strongly recommended, demonstrating significant cognitive and functional improvements. Both drug classes showed favorable safety profiles with manageable side effects.
Conclusions
This guideline offers standardized, evidence-based pharmacologic recommendations for dementia management, with specific guidance on cholinesterase inhibitors and NMDA receptor antagonists. It aims to support clinical decision-making and improve patient outcomes in dementia care. Further updates will address emerging treatments, including amyloid-targeting therapies, to reflect advances in dementia management.

Result Analysis
Print
Save
E-mail