1.Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist
Ji Su KO ; Hwon HEO ; Chong Hyun SUH ; Jeho YI ; Woo Hyun SHIM
Korean Journal of Radiology 2025;26(4):304-312
Objective:
To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.
Materials and Methods:
A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data—were independently extracted by two reviewers, and adherence was calculated for each item.
Results:
Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.
Conclusion
Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
2.Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist
Ji Su KO ; Hwon HEO ; Chong Hyun SUH ; Jeho YI ; Woo Hyun SHIM
Korean Journal of Radiology 2025;26(4):304-312
Objective:
To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.
Materials and Methods:
A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data—were independently extracted by two reviewers, and adherence was calculated for each item.
Results:
Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.
Conclusion
Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
3.Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist
Ji Su KO ; Hwon HEO ; Chong Hyun SUH ; Jeho YI ; Woo Hyun SHIM
Korean Journal of Radiology 2025;26(4):304-312
Objective:
To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.
Materials and Methods:
A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data—were independently extracted by two reviewers, and adherence was calculated for each item.
Results:
Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.
Conclusion
Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
4.Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist
Ji Su KO ; Hwon HEO ; Chong Hyun SUH ; Jeho YI ; Woo Hyun SHIM
Korean Journal of Radiology 2025;26(4):304-312
Objective:
To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.
Materials and Methods:
A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data—were independently extracted by two reviewers, and adherence was calculated for each item.
Results:
Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.
Conclusion
Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
5.Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist
Ji Su KO ; Hwon HEO ; Chong Hyun SUH ; Jeho YI ; Woo Hyun SHIM
Korean Journal of Radiology 2025;26(4):304-312
Objective:
To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.
Materials and Methods:
A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data—were independently extracted by two reviewers, and adherence was calculated for each item.
Results:
Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.
Conclusion
Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
6.Dietary interventions to reduce heavy metal exposure in antepartum and postpartum women: a systematic review
Su Ji HEO ; Nalae MOON ; Ju Hee KIM
Women’s Health Nursing 2024;30(4):265-276
Heavy metals, which are persistent in the environment and toxic, can accumulate in the body and cause organ damage, which may further negatively affect perinatal women and their fetuses. Therefore, this systematic review was conducted to evaluate the effectiveness of dietary interventions to reduce heavy metal exposure in antepartum and postpartum women. Methods: We searched five databases (PubMed, Embase, Scopus, Web of Science, and Cochrane Library) for randomized controlled trials that provided dietary interventions for antepartum and postpartum women. Quality assessments were conducted independently by two reviewers using the Cochrane Risk-of-Bias tool, a quality assessment tool for randomized controlled trials. Results: A total of seven studies were included. The studies were conducted in six countries, with interventions categorized into “nutritional supplements,” “food supply,” and “educational” strategies. Interventions involving nutritional supplements, such as calcium and probiotics, primarily reduced heavy metal levels in the blood and minimized toxicity. Food-based interventions, including specific fruit consumption, decreased heavy metal concentrations in breast milk. Educational interventions effectively promoted behavioral changes, such as adopting diets low in mercury. The studies demonstrated a low overall risk of bias, supporting the reliability of the findings. These strategies underscore the effectiveness of dietary approaches in mitigating heavy metal exposure and improving maternal and child health. Conclusion: The main findings underscore the importance of dietary interventions in reducing heavy metal exposure. This emphasizes the critical role of nursing in guiding dietary strategies to minimize exposure risks, ultimately supporting maternal and fetal health during pregnancy.
7.Dietary interventions to reduce heavy metal exposure in antepartum and postpartum women: a systematic review
Su Ji HEO ; Nalae MOON ; Ju Hee KIM
Women’s Health Nursing 2024;30(4):265-276
Heavy metals, which are persistent in the environment and toxic, can accumulate in the body and cause organ damage, which may further negatively affect perinatal women and their fetuses. Therefore, this systematic review was conducted to evaluate the effectiveness of dietary interventions to reduce heavy metal exposure in antepartum and postpartum women. Methods: We searched five databases (PubMed, Embase, Scopus, Web of Science, and Cochrane Library) for randomized controlled trials that provided dietary interventions for antepartum and postpartum women. Quality assessments were conducted independently by two reviewers using the Cochrane Risk-of-Bias tool, a quality assessment tool for randomized controlled trials. Results: A total of seven studies were included. The studies were conducted in six countries, with interventions categorized into “nutritional supplements,” “food supply,” and “educational” strategies. Interventions involving nutritional supplements, such as calcium and probiotics, primarily reduced heavy metal levels in the blood and minimized toxicity. Food-based interventions, including specific fruit consumption, decreased heavy metal concentrations in breast milk. Educational interventions effectively promoted behavioral changes, such as adopting diets low in mercury. The studies demonstrated a low overall risk of bias, supporting the reliability of the findings. These strategies underscore the effectiveness of dietary approaches in mitigating heavy metal exposure and improving maternal and child health. Conclusion: The main findings underscore the importance of dietary interventions in reducing heavy metal exposure. This emphasizes the critical role of nursing in guiding dietary strategies to minimize exposure risks, ultimately supporting maternal and fetal health during pregnancy.
8.Dietary interventions to reduce heavy metal exposure in antepartum and postpartum women: a systematic review
Su Ji HEO ; Nalae MOON ; Ju Hee KIM
Women’s Health Nursing 2024;30(4):265-276
Heavy metals, which are persistent in the environment and toxic, can accumulate in the body and cause organ damage, which may further negatively affect perinatal women and their fetuses. Therefore, this systematic review was conducted to evaluate the effectiveness of dietary interventions to reduce heavy metal exposure in antepartum and postpartum women. Methods: We searched five databases (PubMed, Embase, Scopus, Web of Science, and Cochrane Library) for randomized controlled trials that provided dietary interventions for antepartum and postpartum women. Quality assessments were conducted independently by two reviewers using the Cochrane Risk-of-Bias tool, a quality assessment tool for randomized controlled trials. Results: A total of seven studies were included. The studies were conducted in six countries, with interventions categorized into “nutritional supplements,” “food supply,” and “educational” strategies. Interventions involving nutritional supplements, such as calcium and probiotics, primarily reduced heavy metal levels in the blood and minimized toxicity. Food-based interventions, including specific fruit consumption, decreased heavy metal concentrations in breast milk. Educational interventions effectively promoted behavioral changes, such as adopting diets low in mercury. The studies demonstrated a low overall risk of bias, supporting the reliability of the findings. These strategies underscore the effectiveness of dietary approaches in mitigating heavy metal exposure and improving maternal and child health. Conclusion: The main findings underscore the importance of dietary interventions in reducing heavy metal exposure. This emphasizes the critical role of nursing in guiding dietary strategies to minimize exposure risks, ultimately supporting maternal and fetal health during pregnancy.
9.Dietary interventions to reduce heavy metal exposure in antepartum and postpartum women: a systematic review
Su Ji HEO ; Nalae MOON ; Ju Hee KIM
Women’s Health Nursing 2024;30(4):265-276
Heavy metals, which are persistent in the environment and toxic, can accumulate in the body and cause organ damage, which may further negatively affect perinatal women and their fetuses. Therefore, this systematic review was conducted to evaluate the effectiveness of dietary interventions to reduce heavy metal exposure in antepartum and postpartum women. Methods: We searched five databases (PubMed, Embase, Scopus, Web of Science, and Cochrane Library) for randomized controlled trials that provided dietary interventions for antepartum and postpartum women. Quality assessments were conducted independently by two reviewers using the Cochrane Risk-of-Bias tool, a quality assessment tool for randomized controlled trials. Results: A total of seven studies were included. The studies were conducted in six countries, with interventions categorized into “nutritional supplements,” “food supply,” and “educational” strategies. Interventions involving nutritional supplements, such as calcium and probiotics, primarily reduced heavy metal levels in the blood and minimized toxicity. Food-based interventions, including specific fruit consumption, decreased heavy metal concentrations in breast milk. Educational interventions effectively promoted behavioral changes, such as adopting diets low in mercury. The studies demonstrated a low overall risk of bias, supporting the reliability of the findings. These strategies underscore the effectiveness of dietary approaches in mitigating heavy metal exposure and improving maternal and child health. Conclusion: The main findings underscore the importance of dietary interventions in reducing heavy metal exposure. This emphasizes the critical role of nursing in guiding dietary strategies to minimize exposure risks, ultimately supporting maternal and fetal health during pregnancy.
10.Dietary interventions to reduce heavy metal exposure in antepartum and postpartum women: a systematic review
Su Ji HEO ; Nalae MOON ; Ju Hee KIM
Women’s Health Nursing 2024;30(4):265-276
Heavy metals, which are persistent in the environment and toxic, can accumulate in the body and cause organ damage, which may further negatively affect perinatal women and their fetuses. Therefore, this systematic review was conducted to evaluate the effectiveness of dietary interventions to reduce heavy metal exposure in antepartum and postpartum women. Methods: We searched five databases (PubMed, Embase, Scopus, Web of Science, and Cochrane Library) for randomized controlled trials that provided dietary interventions for antepartum and postpartum women. Quality assessments were conducted independently by two reviewers using the Cochrane Risk-of-Bias tool, a quality assessment tool for randomized controlled trials. Results: A total of seven studies were included. The studies were conducted in six countries, with interventions categorized into “nutritional supplements,” “food supply,” and “educational” strategies. Interventions involving nutritional supplements, such as calcium and probiotics, primarily reduced heavy metal levels in the blood and minimized toxicity. Food-based interventions, including specific fruit consumption, decreased heavy metal concentrations in breast milk. Educational interventions effectively promoted behavioral changes, such as adopting diets low in mercury. The studies demonstrated a low overall risk of bias, supporting the reliability of the findings. These strategies underscore the effectiveness of dietary approaches in mitigating heavy metal exposure and improving maternal and child health. Conclusion: The main findings underscore the importance of dietary interventions in reducing heavy metal exposure. This emphasizes the critical role of nursing in guiding dietary strategies to minimize exposure risks, ultimately supporting maternal and fetal health during pregnancy.

Result Analysis
Print
Save
E-mail