1.Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist
Ji Su KO ; Hwon HEO ; Chong Hyun SUH ; Jeho YI ; Woo Hyun SHIM
Korean Journal of Radiology 2025;26(4):304-312
Objective:
To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.
Materials and Methods:
A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data—were independently extracted by two reviewers, and adherence was calculated for each item.
Results:
Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.
Conclusion
Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
2.Changing Gadolinium-Based Contrast Agents to Prevent Recurrent Acute Adverse Drug Reactions: 6-Year Cohort Study Using Propensity Score Matching
Min Woo HAN ; Chong Hyun SUH ; Pyeong Hwa KIM ; Seonok KIM ; Ah Young KIM ; Kyung-Hyun DO ; Jeong Hyun LEE ; Dong-Il GWON ; Ah Young JUNG ; Choong Wook LEE
Korean Journal of Radiology 2025;26(2):204-204
3.Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist
Ji Su KO ; Hwon HEO ; Chong Hyun SUH ; Jeho YI ; Woo Hyun SHIM
Korean Journal of Radiology 2025;26(4):304-312
Objective:
To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.
Materials and Methods:
A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data—were independently extracted by two reviewers, and adherence was calculated for each item.
Results:
Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.
Conclusion
Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
4.Changing Gadolinium-Based Contrast Agents to Prevent Recurrent Acute Adverse Drug Reactions: 6-Year Cohort Study Using Propensity Score Matching
Min Woo HAN ; Chong Hyun SUH ; Pyeong Hwa KIM ; Seonok KIM ; Ah Young KIM ; Kyung-Hyun DO ; Jeong Hyun LEE ; Dong-Il GWON ; Ah Young JUNG ; Choong Wook LEE
Korean Journal of Radiology 2025;26(2):204-204
5.Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist
Ji Su KO ; Hwon HEO ; Chong Hyun SUH ; Jeho YI ; Woo Hyun SHIM
Korean Journal of Radiology 2025;26(4):304-312
Objective:
To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.
Materials and Methods:
A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data—were independently extracted by two reviewers, and adherence was calculated for each item.
Results:
Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.
Conclusion
Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
6.Changing Gadolinium-Based Contrast Agents to Prevent Recurrent Acute Adverse Drug Reactions: 6-Year Cohort Study Using Propensity Score Matching
Min Woo HAN ; Chong Hyun SUH ; Pyeong Hwa KIM ; Seonok KIM ; Ah Young KIM ; Kyung-Hyun DO ; Jeong Hyun LEE ; Dong-Il GWON ; Ah Young JUNG ; Choong Wook LEE
Korean Journal of Radiology 2025;26(2):204-204
7.Profiling of Anti-Signal-Recognition Particle Antibodies and Clinical Characteristics in South Korean Patients With Immune-Mediated Necrotizing Myopathy
Soo-Hyun KIM ; Yunjung CHOI ; Eun Kyoung OH ; Ichizo NISHINO ; Shigeaki SUZUKI ; Bum Chun SUH ; Ha Young SHIN ; Seung Woo KIM ; Byeol-A YOON ; Seong-il OH ; Yoo Hwan KIM ; Hyunjin KIM ; Young-Min LIM ; Seol-Hee BAEK ; Je-Young SHIN ; Hung Youl SEOK ; Seung-Ah LEE ; Young-Chul CHOI ; Hyung Jun PARK
Journal of Clinical Neurology 2025;21(1):31-39
Background:
and Purpose This study evaluated the diagnostic utility of an anti-signal-recognition particle 54 (anti-SRP54) antibody-based enzyme-linked immunosorbent assay (ELISA) as well as the clinical, serological, and pathological characteristics of patients with SRP immune-mediated necrotizing myopathy (IMNM).
Methods:
We evaluated 87 patients with idiopathic inflammatory myopathy and 107 healthy participants between January 2002 and December 2023. The sensitivity and specificity of the ELISA for anti-SRP54 antibodies were assessed, and the clinical profiles of patients with antiSRP54 antibodies were determined.
Results:
The ELISA for anti-SRP54 antibodies had a sensitivity and specificity of 88% and 99%, respectively, along with a test–retest reliability of 0.92 (p<0.001). The 32 patients diagnosed with anti-SRP IMNM using a line-blot immunoassay included 28 (88%) who tested positive for anti-SRP54 antibodies using the ELISA, comprising 12 (43%) males and 16 (57%) females whose median ages at symptom onset and diagnosis were 43.0 years and 43.5 years, respectively. Symptoms included proximal muscle weakness in all 28 (100%) patients, neck weakness in 9 (32%), myalgia in 15 (54%), dysphagia in 5 (18%), dyspnea in 4 (14%), dysarthria in 2 (7%), interstitial lung disease in 2 (7%), and myocarditis in 2 (7%). The median serum creatine kinase (CK) level was 7,261 U/L (interquartile range: 5,086–10,007 U/L), and the median anti-SRP54 antibody level was 2.0 U/mL (interquartile range: 1.0–5.6 U/mL). The serum CK level was significantly higher in patients with coexisting anti-Ro-52 antibodies.
Conclusions
This study has confirmed the reliability of the ELISA for anti-SRP54 antibodies and provided insights into the clinical, serological, and pathological characteristics of South Korean patients with anti-SRP IMNM.
8.Clinical practice guidelines for uterine corpus cancer: an update to the Korean Society of Gynecologic Oncology guidelines
Woo Yeon HWANG ; Ju-Hyun KIM ; Joseph J. NOH ; Min-Hyun BAEK ; Min Chul CHOI ; Yong Jae LEE ; Maria LEE ; Dong Hoon SUH ; Yong Beom KIM ; Dae-Yeon KIM
Journal of Gynecologic Oncology 2025;36(1):e71-
The Korean Society of Gynecologic Oncology has updated its clinical practice guidelines for endometrial cancer to incorporate advancements in recent high-quality randomized controlled trials. These guidelines address evolving treatment paradigms, and are tailored to the Korean medical context. Key updates include a strong recommendation for doxorubicin/trabectedin combination therapy in metastatic or recurrent unresectable leiomyosarcoma based on the significant survival benefits demonstrated in a randomized controlled trial. For advanced or recurrent endometrial cancer, immune checkpoint inhibitors combined with chemotherapy have received strong recommendations, owing to their proven efficacy and increased accessibility in Korea. Conditional recommendations were made for combination therapies involving durvalumab and olaparib, reflecting their potential benefits, but acknowledging regulatory and accessibility constraints. These guidelines aim to provide evidence-based, practical strategies to optimize care for patients with endometrial cancer while addressing unmet clinical needs and adapting global advancements to Korea’s healthcare environment.
9.Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist
Ji Su KO ; Hwon HEO ; Chong Hyun SUH ; Jeho YI ; Woo Hyun SHIM
Korean Journal of Radiology 2025;26(4):304-312
Objective:
To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.
Materials and Methods:
A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data—were independently extracted by two reviewers, and adherence was calculated for each item.
Results:
Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.
Conclusion
Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
10.Changing Gadolinium-Based Contrast Agents to Prevent Recurrent Acute Adverse Drug Reactions: 6-Year Cohort Study Using Propensity Score Matching
Min Woo HAN ; Chong Hyun SUH ; Pyeong Hwa KIM ; Seonok KIM ; Ah Young KIM ; Kyung-Hyun DO ; Jeong Hyun LEE ; Dong-Il GWON ; Ah Young JUNG ; Choong Wook LEE
Korean Journal of Radiology 2025;26(2):204-204

Result Analysis
Print
Save
E-mail