1.Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist
Ji Su KO ; Hwon HEO ; Chong Hyun SUH ; Jeho YI ; Woo Hyun SHIM
Korean Journal of Radiology 2025;26(4):304-312
Objective:
To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.
Materials and Methods:
A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data—were independently extracted by two reviewers, and adherence was calculated for each item.
Results:
Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.
Conclusion
Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
2.Factors Associated with Postoperative Recurrence in Stage I to IIIA Non–Small Cell Lung Cancer with Epidermal Growth Factor Receptor Mutation: Analysis of Korean National Population Data
Kyu Yean KIM ; Ho Cheol KIM ; Tae Jung KIM ; Hong Kwan KIM ; Mi Hyung MOON ; Kyongmin Sarah BECK ; Yang Gun SUH ; Chang Hoon SONG ; Jin Seok AHN ; Jeong Eun LEE ; Jae Hyun JEON ; Chi Young JUNG ; Jeong Su CHO ; Yoo Duk CHOI ; Seung Sik HWANG ; Chang Min CHOI ; Seung Hun JANG ; Jeong Uk LIM ;
Cancer Research and Treatment 2025;57(1):83-94
Purpose:
Recent development in perioperative treatment of resectable non–small cell lung cancer (NSCLC) have changed the landscape of early lung cancer management. The ADAURA trial has demonstrated the efficacy of adjuvant osimertinib treatment in resectable NSCLC patients; however, studies are required to show which subgroup of patients are at a high risk of relapse and require adjuvant epidermal growth factor receptor (EGFR) tyrosine kinase inhibitor treatment. This study evaluated risk factors for postoperative relapse among patients who underwent complete resection.
Materials and Methods:
Data were obtained from the Korean Association for Lung Cancer Registry (KALC-R), a database created using a retrospective sampling survey by the Korean Central Cancer Registry (KCCR) and the Lung Cancer Registration Committee.
Results:
A total of 3,176 patients who underwent curative resection was evaluated. The mean observation time was approximately 35.4 months. Among stage I to IIIA NSCLC patients, the EGFR-mutant subgroup included 867 patients, and 75.2%, 11.2%, and 11.8% were classified as stage I, stage II, and stage III, respectively. Within the EGFR-mutant subgroup, 44 (5.1%) and 121 (14.0%) patients showed early and late recurrence, respectively. Multivariate analysis on association with postoperative relapse among the EGFR-mutant subgroup showed that age, pathologic N and TNM stages, pleural invasion status, and surgery type were independent significant factors.
Conclusion
Among the population that underwent complete resection for early NSCLC with EGFR mutation, patients with advanced stage, pleural invasion, or limited resection are more likely to show postoperative relapse.
3.Prognostic Evaluation and Survival Prediction for Combined Hepatocellular-Cholangiocarcinoma Following Hepatectomy
Seok-Joo CHUN ; Yu Jung JUNG ; YoungRok CHOI ; Nam-Joon YI ; Kwang-Woong LEE ; Kyung-Suk SUH ; Kyoung Bun LEE ; Hyun-Cheol KANG ; Eui Kyu CHIE ; Kyung Su KIM
Cancer Research and Treatment 2025;57(1):229-239
Purpose:
This study aimed to assess prognostic factors associated with combined hepatocellular-cholangiocarcinoma (cHCC-CCA) and to predict 5-year survival based on these factors.
Materials and Methods:
Patients who underwent definitive hepatectomy from 2006 to 2022 at a single institution was retrospectively analyzed. Inclusion criteria involved a pathologically confirmed diagnosis of cHCC-CCA.
Results:
A total of 80 patients with diagnosed cHCC-CCA were included in the analysis. The median progression-free survival was 15.6 months, while distant metastasis-free survival (DMFS), hepatic progression-free survival, and overall survival (OS) were 50.8, 21.5, and 85.1 months, respectively. In 52 cases of recurrence, intrahepatic recurrence was the most common initial recurrence (34/52), with distant metastasis in 17 cases. Factors associated with poor DMFS included tumor necrosis, lymphovascular invasion (LVI), perineural invasion, and histologic compact type. Postoperative carbohydrate antigen 19-9, tumor necrosis, LVI, and close/positive margin were associated with poor OS. LVI emerged as a key factor affecting both DMFS and OS, with a 5-year OS of 93.3% for patients without LVI compared to 35.8% with LVI. Based on these factors, a nomogram predicting 3-year and 5-year DMFS and OS was developed, demonstrating high concordance with actual survival in the cohort (Harrell C-index 0.809 for OS, 0.801 for DMFS, respectively).
Conclusion
The prognosis of cHCC-CCA is notably poor when combined with LVI. Given the significant impact of adverse features, accurate outcome prediction is crucial. Moreover, consideration of adjuvant therapy may be warranted for patients exhibiting poor survival and increased risk of local recurrence or distant metastasis.
4.Feasibility of indocyanine green fluorescence imaging to predict biliary complications in living donor liver transplantation: A pilot study
Jaewon LEE ; YoungRok CHOI ; Nam-Joon YI ; Jae-Yoon KIM ; Su young HONG ; Jeong-Moo LEE ; Suk Kyun HONG ; Kwang-Woong LEE ; Kyung-Suk SUH
Annals of Hepato-Biliary-Pancreatic Surgery 2025;29(1):32-37
Background:
s/Aims: Liver transplantation (LT) is now a critical, life-saving treatment for patients with liver cirrhosis or hepatocellular carcinoma. Despite its significant benefits, biliary complications (BCs) continue to be a major cause of postoperative morbidity.This study evaluates the fluorescence intensity (FI) of the common bile duct (CBD) utilizing near-infrared indocyanine green (ICG) imaging, and examines its association with the incidence of BCs within three months post-LT.
Methods:
This investigation analyzed data from nine living donor LT (LDLT) recipients who were administered 0.05 mg/kg of ICG prior to bile duct anastomosis. Real-time perfusion of the CBD was recorded for three minutes using an ICG camera, and FI was quantified using Image J (National Institutes of Health). Key parameters assessed included F max, F1/2 max, T1/2 max, and the slope (F max/ T max) to evaluate the fluorescence response.
Results:
BCs occurred in two out of nine patients. These two patients exhibited the longest T1/2 max values, which were linked with lower slope values, implicating a potential relationship between extended T1/2 max, reduced slope, and the occurrence of postoperative BCs.
Conclusions
The study indicates that ICG fluorescence imaging may serve as an effective tool for assessing bile duct perfusion in LDLT patients. While the data suggest that an extended T1/2 max and lower slope may correlate with an increased risk of BCs, further validation through larger studies is required to confirm the predictive value of ICG fluorescence imaging in this setting.
5.Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist
Ji Su KO ; Hwon HEO ; Chong Hyun SUH ; Jeho YI ; Woo Hyun SHIM
Korean Journal of Radiology 2025;26(4):304-312
Objective:
To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.
Materials and Methods:
A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data—were independently extracted by two reviewers, and adherence was calculated for each item.
Results:
Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.
Conclusion
Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
6.Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist
Ji Su KO ; Hwon HEO ; Chong Hyun SUH ; Jeho YI ; Woo Hyun SHIM
Korean Journal of Radiology 2025;26(4):304-312
Objective:
To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.
Materials and Methods:
A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data—were independently extracted by two reviewers, and adherence was calculated for each item.
Results:
Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.
Conclusion
Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
7.Clinical practice guidelines for ovarian cancer: an update to the Korean Society of Gynecologic Oncology guidelines
Banghyun LEE ; Suk-Joon CHANG ; Byung Su KWON ; Joo-Hyuk SON ; Myong Cheol LIM ; Yun Hwan KIM ; Shin-Wha LEE ; Chel Hun CHOI ; Kyung Jin EOH ; Jung-Yun LEE ; Yoo-Young LEE ; Dong Hoon SUH ; Yong Beom KIM
Journal of Gynecologic Oncology 2025;36(1):e69-
We updated the Korean Society of Gynecologic Oncology (KSGO) practice guideline for the management of ovarian cancer as version 5.1. The ovarian cancer guideline team of the KSGO published announced the fifth version (version 5.0) of its clinical practice guidelines for the management of ovarian cancer in December 2023. In version 5.0, the selection of the key questions and the systematic reviews were based on the data available up to December 2022.Therefore, we updated the guidelines version 5.0 with newly accumulated clinical data and added 5 new key questions reflecting the latest insights in the field of ovarian cancer between 2023 and 2024. For each question, recommendation was provided together with corresponding level of evidence and grade of recommendation, all established through expert consensus.
8.Feasibility of indocyanine green fluorescence imaging to predict biliary complications in living donor liver transplantation: A pilot study
Jaewon LEE ; YoungRok CHOI ; Nam-Joon YI ; Jae-Yoon KIM ; Su young HONG ; Jeong-Moo LEE ; Suk Kyun HONG ; Kwang-Woong LEE ; Kyung-Suk SUH
Annals of Hepato-Biliary-Pancreatic Surgery 2025;29(1):32-37
Background:
s/Aims: Liver transplantation (LT) is now a critical, life-saving treatment for patients with liver cirrhosis or hepatocellular carcinoma. Despite its significant benefits, biliary complications (BCs) continue to be a major cause of postoperative morbidity.This study evaluates the fluorescence intensity (FI) of the common bile duct (CBD) utilizing near-infrared indocyanine green (ICG) imaging, and examines its association with the incidence of BCs within three months post-LT.
Methods:
This investigation analyzed data from nine living donor LT (LDLT) recipients who were administered 0.05 mg/kg of ICG prior to bile duct anastomosis. Real-time perfusion of the CBD was recorded for three minutes using an ICG camera, and FI was quantified using Image J (National Institutes of Health). Key parameters assessed included F max, F1/2 max, T1/2 max, and the slope (F max/ T max) to evaluate the fluorescence response.
Results:
BCs occurred in two out of nine patients. These two patients exhibited the longest T1/2 max values, which were linked with lower slope values, implicating a potential relationship between extended T1/2 max, reduced slope, and the occurrence of postoperative BCs.
Conclusions
The study indicates that ICG fluorescence imaging may serve as an effective tool for assessing bile duct perfusion in LDLT patients. While the data suggest that an extended T1/2 max and lower slope may correlate with an increased risk of BCs, further validation through larger studies is required to confirm the predictive value of ICG fluorescence imaging in this setting.
9.Factors Associated with Postoperative Recurrence in Stage I to IIIA Non–Small Cell Lung Cancer with Epidermal Growth Factor Receptor Mutation: Analysis of Korean National Population Data
Kyu Yean KIM ; Ho Cheol KIM ; Tae Jung KIM ; Hong Kwan KIM ; Mi Hyung MOON ; Kyongmin Sarah BECK ; Yang Gun SUH ; Chang Hoon SONG ; Jin Seok AHN ; Jeong Eun LEE ; Jae Hyun JEON ; Chi Young JUNG ; Jeong Su CHO ; Yoo Duk CHOI ; Seung Sik HWANG ; Chang Min CHOI ; Seung Hun JANG ; Jeong Uk LIM ;
Cancer Research and Treatment 2025;57(1):83-94
Purpose:
Recent development in perioperative treatment of resectable non–small cell lung cancer (NSCLC) have changed the landscape of early lung cancer management. The ADAURA trial has demonstrated the efficacy of adjuvant osimertinib treatment in resectable NSCLC patients; however, studies are required to show which subgroup of patients are at a high risk of relapse and require adjuvant epidermal growth factor receptor (EGFR) tyrosine kinase inhibitor treatment. This study evaluated risk factors for postoperative relapse among patients who underwent complete resection.
Materials and Methods:
Data were obtained from the Korean Association for Lung Cancer Registry (KALC-R), a database created using a retrospective sampling survey by the Korean Central Cancer Registry (KCCR) and the Lung Cancer Registration Committee.
Results:
A total of 3,176 patients who underwent curative resection was evaluated. The mean observation time was approximately 35.4 months. Among stage I to IIIA NSCLC patients, the EGFR-mutant subgroup included 867 patients, and 75.2%, 11.2%, and 11.8% were classified as stage I, stage II, and stage III, respectively. Within the EGFR-mutant subgroup, 44 (5.1%) and 121 (14.0%) patients showed early and late recurrence, respectively. Multivariate analysis on association with postoperative relapse among the EGFR-mutant subgroup showed that age, pathologic N and TNM stages, pleural invasion status, and surgery type were independent significant factors.
Conclusion
Among the population that underwent complete resection for early NSCLC with EGFR mutation, patients with advanced stage, pleural invasion, or limited resection are more likely to show postoperative relapse.
10.Prognostic Evaluation and Survival Prediction for Combined Hepatocellular-Cholangiocarcinoma Following Hepatectomy
Seok-Joo CHUN ; Yu Jung JUNG ; YoungRok CHOI ; Nam-Joon YI ; Kwang-Woong LEE ; Kyung-Suk SUH ; Kyoung Bun LEE ; Hyun-Cheol KANG ; Eui Kyu CHIE ; Kyung Su KIM
Cancer Research and Treatment 2025;57(1):229-239
Purpose:
This study aimed to assess prognostic factors associated with combined hepatocellular-cholangiocarcinoma (cHCC-CCA) and to predict 5-year survival based on these factors.
Materials and Methods:
Patients who underwent definitive hepatectomy from 2006 to 2022 at a single institution was retrospectively analyzed. Inclusion criteria involved a pathologically confirmed diagnosis of cHCC-CCA.
Results:
A total of 80 patients with diagnosed cHCC-CCA were included in the analysis. The median progression-free survival was 15.6 months, while distant metastasis-free survival (DMFS), hepatic progression-free survival, and overall survival (OS) were 50.8, 21.5, and 85.1 months, respectively. In 52 cases of recurrence, intrahepatic recurrence was the most common initial recurrence (34/52), with distant metastasis in 17 cases. Factors associated with poor DMFS included tumor necrosis, lymphovascular invasion (LVI), perineural invasion, and histologic compact type. Postoperative carbohydrate antigen 19-9, tumor necrosis, LVI, and close/positive margin were associated with poor OS. LVI emerged as a key factor affecting both DMFS and OS, with a 5-year OS of 93.3% for patients without LVI compared to 35.8% with LVI. Based on these factors, a nomogram predicting 3-year and 5-year DMFS and OS was developed, demonstrating high concordance with actual survival in the cohort (Harrell C-index 0.809 for OS, 0.801 for DMFS, respectively).
Conclusion
The prognosis of cHCC-CCA is notably poor when combined with LVI. Given the significant impact of adverse features, accurate outcome prediction is crucial. Moreover, consideration of adjuvant therapy may be warranted for patients exhibiting poor survival and increased risk of local recurrence or distant metastasis.

Result Analysis
Print
Save
E-mail