A survey of transfusion medicine knowledge among pediatricians/postgraduates and an evaluation of large language models for learning assistance
10.13303/j.cjbt.issn.1004-549x.2026.03.004
- VernacularTitle:儿科医师/研究生输血医学知识认知现状与大语言模型辅助学习的可靠性研究
- Author:
Haiting LIU
1
;
Xueyuan HUANG
1
;
Minghua YANG
2
;
Qiushi WANG
3
;
Rong HUANG
1
;
Rong GUI
1
Author Information
1. Department of Blood Transfusion, Xiangya Third Hospital, Central South University, Changsha 410013, China
2. Department of Pediatrics, Xiangya Third Hospital, Central South University, Changsha 410013, China
3. Department of Blood Transfusion, The Affiliated Shengjing Hospital of China Medical University, Shenyang 110004, China
- Publication Type:Journal Article
- Keywords:
pediatrics;
transfusion medicine;
large language models;
pediatric transfusion guideline;
questionnaire survey
- From:
Chinese Journal of Blood Transfusion
2026;39(3):329-338
- CountryChina
- Language:Chinese
-
Abstract:
Objective: To investigate the current knowledge status of transfusion medicine among pediatricians/postgraduates and the reliability of large language models (LLMs) for assisted learning, and to assess changes in pediatricians' transfusion medicine knowledge before and after the implementation of the "Pediatric Transfusion Guideline" (hereafter referred to as the "Guideline"). Methods: In January 2022 (prior to the implementation of the "Guideline"), a questionnaire was developed based on the "Guideline" content and distributed to pediatricians. Subsequently, in July 2025 (after the implementation of the "Guideline"), the "Pediatric Transfusion Medicine Knowledge Questionnaire" was designed based on the content of the January 2022 questionnaire. This questionnaire survey was conducted on pediatricians/postgraduates and LLMs. We analyzed the level of transfusion medicine knowledge among pediatricians/postgraduates and the reliability of LLMs for assisted learning, and compared the accuracy of pediatricians' responses before and after "Guideline" implementation. Results: The survey results after the implementation of the "Guidelines" revealed that pediatricians/postgraduates achieved response accuracy rates exceeding 80% on the topic of "Patient Blood Management". However, response accuracy rates were below 30% for topics including "Types and Indications of Blood Components/Products" and "E-valuation of Transfusion Efficacy". The pediatricians' accuracy rates for related questions before and after the implementation of the "Guidelines" were 14.7%-68.9% and 3%-38%, respectively, and the comparison of accuracy rates for each question showed significant differences (P<0.001). The accuracy rates of the LLMs on the questionnaire were all below 90%. Among them, Doubao (81.1%) and Kimi (86.4%) achieved relatively higher accuracy rates, while Tencent Yuanbao (Hunyuan) had the lowest accuracy rate at only 59.5%. Conclusion: The implementation of the "Guideline" may have improved pediatricians' knowledge level of pediatric transfusion medicine. However, their knowledge level of pediatric transfusion remains low, and LLMs cannot yet provide absolutely reliable guidance. Systematic training in pediatric transfusion medicine is urgently needed.
