1.Research on the development of entrustable professional activity indicators for residents in China: a systematic review
Jingyu ZHONG ; Yue XING ; Liangjing LÜ ; Qinghua MIN ; Zhengguang XIAO ; Caisong ZHU ; Dandan SHI ; Xiaoyu FAN ; Jingshen CHU ; Huan ZHANG ; Yi JIANG ; Weiwu YAO
Chinese Journal of Medical Education Research 2025;24(6):728-735
Objective:To systematically evaluate the current status of research on the development of indicators for entrustable professional activities (EPAs) of residents in China.Methods:We searched the China National Knowledge Infrastructure, Wanfang Data, Airiti Library, PubMed, Embase, and Web of Science databases for literature on the development of EPA indicators for residents in China published between January 1, 2005 and February 28, 2025. Two researchers independently screened the literature and extracted data, followed by descriptive analysis. The quality of the studies was assessed using the Joanna Briggs Institute critical appraisal tool for expert opinion. Quantitative data were presented as medians (ranges) and qualitative data were presented as frequencies (percentages).Results:A total of eight articles were included, in which two general EPA indicator systems and six specialty-specific EPA indicator systems were developed for residents. The overall quality of the research was high, with the main shortcomings related to the methods used in the process of constructing the consensus indicators. The number of experts recruited ranged from 22 to 45, with 100.00% response rate, high authority coefficients (0.820-0.914), and high coordination coefficients (0.157-0.741). Most of the studies used literature reviews as one source for the indicator pool (8 studies, 100.00%), employed the Delphi method to reach consensus (6 studies, 75.00%), and provided inclusion criteria for the indicators (7 studies, 87.50%). However, only one study (12.50%) explored the practical application of the developed indicators, and none of the studies set indicator weights or conducted quality assessments. The number of EPA indicators developed ranged from 10 to 38 per study. The reporting of EPA indicators was included in most studies regarding titles (8 studies, 100.00%) and the expected levels of entrustment at various stages of training (6 studies, 75.00%), but the reporting on other aspects was lacking. Among the specialty-specific EPA indicators, 38.39% overlapped with the general EPAs indicators.Conclusions:The research on the development of EPA indicators for residents in China is still in its early stages, and there is room for improvement in methodological quality and reporting coverage. There is partial overlap between specialty-specific and general EPA indicators, failing to fully reflect the unique characteristics of different specialties.
2.Accuracy and quality of answer reasoning of Chinese large language model in Chinese middle level professional qualification examination of radiology
Jingyu ZHONG ; Yue XING ; Yangfan HU ; Qinghua MIN ; Caisong ZHU ; Dandan SHI ; Xiaoyu FAN ; Jingshen CHU ; Huan ZHANG ; Weiwu YAO
Chinese Journal of Medical Education Research 2025;24(2):145-149
Objective:To compare the accuracy of a Chinese large language model (LLM) and radiologists in Chinese middle level professional qualification examination of radiology, and evaluate the quality of answer reasoning provided by the Chinese LLM.Methods:In this study, 100 high-quality questions were selected using stratified random sampling to form a test set. We asked the ERNIE Bot by dialogues on the website to provide the correct answers and answer reasoning for these questions. These questions were also answered by 15 radiologists with different levels of experience. The accuracy of Chinese LLM and that of radiologists were compared. Two radiologists evaluated the quality of answer reasoning using a 5-point semi-quantitative scale.Results:The accuracy of ERNIE Bot was 60.00%, which was lower than the median (interquartile) accuracy of 67.00% (64.00%, 73.00%) for radiologists, and the difference was statistically significant ( W=2.47, P=0.013). The word count of the reasoning provided by Ernie Bot was (196.44±99.25) words, with no significant difference in word count between correct and incorrect answer reasoning, which were (211.03±107.53) words and (174.55±81.84) words, respectively ( t=1.82, P=0.072). Among the correct answers, the quality of reasoning was scored as follows: 1 point for 3 questions, 2 points for 9 questions, 3 points for 12 questions, and 4 points for 36 questions. No reasoning received a score of 5. Conclusions:Chinese LLM demonstrates a certain level of medical knowledge and clinical reasoning ability, which can assist clinical teachers in educational activities. However, it is not yet able to independently tutor residents and lacks the ability of invitational and heuristic teaching.
3.An investigation of the current status of Chinese-foreign cooperative education programs for medical majors
Jingyu ZHONG ; Yue XING ; Qinghua MIN ; Zhengguang XIAO ; Caisong ZHU ; Dandan SHI ; Xiaoyu FAN ; Jingshen CHU ; Huan ZHANG ; Yi JIANG ; Weiwu YAO
Chinese Journal of Medical Education Research 2025;24(5):577-582
Objective:To investigate the current status of Chinese-foreign cooperative education programs for medical majors, and to discuss the potential problems and development trends of this field.Methods:Related data were collected from the information platform of Chinese-Foreign Cooperation in Running Schools by Ministry of Education of the People's Republic of China, and the characteristics of Chinese-foreign cooperative education programs for medical majors were extracted for analysis. Categorical data were expressed as frequency (percentage), and continuous data were expressed as mean±standard deviation.Results:A total of 83 Chinese-foreign cooperative education programs for medical majors were included in the study, accounting for only 3.45% (83/2 406) of all programs. Chinese partners in these cooperative programs were mainly from East China (41 programs, 49.40%), while foreign partners were mainly from Europe (39 programs, 46.99%). The mean duration of these programs was (3.61±0.88) years, with an enrollment of (87.08±35.52) students. Most of the students were included in National General Higher Education Enrollment Plan (79 programs, 95.18%), and the main majors included nursing (39 programs, 46.99%), medical technology (19 programs, 22.89%), and clinical medicine (11 programs, 13.25%), with the main enrollment level of junior college (45 programs, 54.22%). Chinese partners in the cooperative programs mainly issued academic certificate (45 programs, 54.22%) or academic certificate plus degree certificate (36 programs, 43.37%), while most foreign partners did not issue such certificates (44 programs, 53.01%).Conclusions:There are several problems in Chinese-foreign cooperative education programs for medical majors, such as a limited number of programs, a significant regional difference, an imbalanced distribution of specialties, a low level of education, and inconsistency in issuance of certificates, which still requires further improvement and standardization. However, there are also high-level and high-quality programs for reference.
4.Research on the development of entrustable professional activity indicators for residents in China: a systematic review
Jingyu ZHONG ; Yue XING ; Liangjing LÜ ; Qinghua MIN ; Zhengguang XIAO ; Caisong ZHU ; Dandan SHI ; Xiaoyu FAN ; Jingshen CHU ; Huan ZHANG ; Yi JIANG ; Weiwu YAO
Chinese Journal of Medical Education Research 2025;24(6):728-735
Objective:To systematically evaluate the current status of research on the development of indicators for entrustable professional activities (EPAs) of residents in China.Methods:We searched the China National Knowledge Infrastructure, Wanfang Data, Airiti Library, PubMed, Embase, and Web of Science databases for literature on the development of EPA indicators for residents in China published between January 1, 2005 and February 28, 2025. Two researchers independently screened the literature and extracted data, followed by descriptive analysis. The quality of the studies was assessed using the Joanna Briggs Institute critical appraisal tool for expert opinion. Quantitative data were presented as medians (ranges) and qualitative data were presented as frequencies (percentages).Results:A total of eight articles were included, in which two general EPA indicator systems and six specialty-specific EPA indicator systems were developed for residents. The overall quality of the research was high, with the main shortcomings related to the methods used in the process of constructing the consensus indicators. The number of experts recruited ranged from 22 to 45, with 100.00% response rate, high authority coefficients (0.820-0.914), and high coordination coefficients (0.157-0.741). Most of the studies used literature reviews as one source for the indicator pool (8 studies, 100.00%), employed the Delphi method to reach consensus (6 studies, 75.00%), and provided inclusion criteria for the indicators (7 studies, 87.50%). However, only one study (12.50%) explored the practical application of the developed indicators, and none of the studies set indicator weights or conducted quality assessments. The number of EPA indicators developed ranged from 10 to 38 per study. The reporting of EPA indicators was included in most studies regarding titles (8 studies, 100.00%) and the expected levels of entrustment at various stages of training (6 studies, 75.00%), but the reporting on other aspects was lacking. Among the specialty-specific EPA indicators, 38.39% overlapped with the general EPAs indicators.Conclusions:The research on the development of EPA indicators for residents in China is still in its early stages, and there is room for improvement in methodological quality and reporting coverage. There is partial overlap between specialty-specific and general EPA indicators, failing to fully reflect the unique characteristics of different specialties.
5.Accuracy and quality of answer reasoning of Chinese large language model in Chinese middle level professional qualification examination of radiology
Jingyu ZHONG ; Yue XING ; Yangfan HU ; Qinghua MIN ; Caisong ZHU ; Dandan SHI ; Xiaoyu FAN ; Jingshen CHU ; Huan ZHANG ; Weiwu YAO
Chinese Journal of Medical Education Research 2025;24(2):145-149
Objective:To compare the accuracy of a Chinese large language model (LLM) and radiologists in Chinese middle level professional qualification examination of radiology, and evaluate the quality of answer reasoning provided by the Chinese LLM.Methods:In this study, 100 high-quality questions were selected using stratified random sampling to form a test set. We asked the ERNIE Bot by dialogues on the website to provide the correct answers and answer reasoning for these questions. These questions were also answered by 15 radiologists with different levels of experience. The accuracy of Chinese LLM and that of radiologists were compared. Two radiologists evaluated the quality of answer reasoning using a 5-point semi-quantitative scale.Results:The accuracy of ERNIE Bot was 60.00%, which was lower than the median (interquartile) accuracy of 67.00% (64.00%, 73.00%) for radiologists, and the difference was statistically significant ( W=2.47, P=0.013). The word count of the reasoning provided by Ernie Bot was (196.44±99.25) words, with no significant difference in word count between correct and incorrect answer reasoning, which were (211.03±107.53) words and (174.55±81.84) words, respectively ( t=1.82, P=0.072). Among the correct answers, the quality of reasoning was scored as follows: 1 point for 3 questions, 2 points for 9 questions, 3 points for 12 questions, and 4 points for 36 questions. No reasoning received a score of 5. Conclusions:Chinese LLM demonstrates a certain level of medical knowledge and clinical reasoning ability, which can assist clinical teachers in educational activities. However, it is not yet able to independently tutor residents and lacks the ability of invitational and heuristic teaching.
6.An investigation of the current status of Chinese-foreign cooperative education programs for medical majors
Jingyu ZHONG ; Yue XING ; Qinghua MIN ; Zhengguang XIAO ; Caisong ZHU ; Dandan SHI ; Xiaoyu FAN ; Jingshen CHU ; Huan ZHANG ; Yi JIANG ; Weiwu YAO
Chinese Journal of Medical Education Research 2025;24(5):577-582
Objective:To investigate the current status of Chinese-foreign cooperative education programs for medical majors, and to discuss the potential problems and development trends of this field.Methods:Related data were collected from the information platform of Chinese-Foreign Cooperation in Running Schools by Ministry of Education of the People's Republic of China, and the characteristics of Chinese-foreign cooperative education programs for medical majors were extracted for analysis. Categorical data were expressed as frequency (percentage), and continuous data were expressed as mean±standard deviation.Results:A total of 83 Chinese-foreign cooperative education programs for medical majors were included in the study, accounting for only 3.45% (83/2 406) of all programs. Chinese partners in these cooperative programs were mainly from East China (41 programs, 49.40%), while foreign partners were mainly from Europe (39 programs, 46.99%). The mean duration of these programs was (3.61±0.88) years, with an enrollment of (87.08±35.52) students. Most of the students were included in National General Higher Education Enrollment Plan (79 programs, 95.18%), and the main majors included nursing (39 programs, 46.99%), medical technology (19 programs, 22.89%), and clinical medicine (11 programs, 13.25%), with the main enrollment level of junior college (45 programs, 54.22%). Chinese partners in the cooperative programs mainly issued academic certificate (45 programs, 54.22%) or academic certificate plus degree certificate (36 programs, 43.37%), while most foreign partners did not issue such certificates (44 programs, 53.01%).Conclusions:There are several problems in Chinese-foreign cooperative education programs for medical majors, such as a limited number of programs, a significant regional difference, an imbalanced distribution of specialties, a low level of education, and inconsistency in issuance of certificates, which still requires further improvement and standardization. However, there are also high-level and high-quality programs for reference.
7.Interpretation of the radiologist training system in Canada and enlightenment
Jingyu ZHONG ; Yue XING ; Yangfan HU ; Defang DING ; Xianwei LIU ; Qinghua MIN ; Zhengguang XIAO ; Caisong ZHU ; Dandan SHI ; Xiaoyu FAN ; Jingshen CHU ; Huan ZHANG ; Weiwu YAO
Chinese Journal of Medical Education Research 2024;23(9):1210-1216
This paper aims to discuss the ideas and experience about the radiology residency training system of Canada with a presentation of its base accreditation standards for five aspects, competency goals for seven roles, four stages of training arrangement, and two types of final assessment questions. Although the Canada's radiology residency program differs from China's standardized resident and specialist training programs for radiology, there are still several points that are worth referencing, including emphasizing the training priority of competency goals, providing a specific basis for the stratification of training, offering clear guidance for the implementation of training content, and improving assessment methods to focus on competency goals. These points are of great value for improving the standardized radiology resident and specialist training programs in China, so as to provide a reference for the training of excellent radiologists in China.
8.Application of Eurorad database in the teaching of radiology in standardized residency training: A case study of teaching film-reading
Jingyu ZHONG ; Qinhua MIN ; Caisong ZHU ; Zhenmin JIANG ; Yifan WANG ; Huan ZHANG ; Weiwu YAO
Chinese Journal of Medical Education Research 2024;23(1):134-139
The teaching of radiology in standardized residency training needs a large number of case data to strengthen the subjective understanding and awareness of residents. The database built by residency training bases can meet the needs of teaching to a certain extent, but the conditions of training bases vary across regions, which makes it difficult to achieve homogeneity in the teaching of radiology. This article discusses the application of Eurorad database in the teaching of radiology in standardized residency training. This database is free of charge, reliable, and comprehensive and provides a large number of free reliable cases and images for teaching, covering both common and rare diseases. Moreover, it can also be used to cultivate the English ability and comprehensive quality of residents and help to establish a hierarchical training system for radiology and non-radiology residents, thereby promoting the improvement in the quality of standardized residency training. This article shows the potential value of Eurorad database in the teaching of radiology in standardized residency training, and comparative studies are needed in the future to further prove its effectiveness.
9.Monitoring Response to Neoadjuvant Chemotherapy of Primary Osteosarcoma Using Diffusion Kurtosis Magnetic Resonance Imaging: Initial Findings
Chenglei LIU ; Yan XI ; Mei LI ; Qiong JIAO ; Huizhen ZHANG ; Qingcheng YANG ; Weiwu YAO
Korean Journal of Radiology 2019;20(5):801-811
OBJECTIVE: To determine whether diffusion kurtosis imaging (DKI) is effective in monitoring tumor response to neoadjuvant chemotherapy in patients with osteosarcoma. MATERIALS AND METHODS: Twenty-nine osteosarcoma patients (20 men and 9 women; mean age, 17.6 ± 7.8 years) who had undergone magnetic resonance imaging (MRI) and DKI before and after neoadjuvant chemotherapy were included. Tumor volume, apparent diffusion coefficient (ADC), mean diffusivity (MD), mean kurtosis (MK), and change ratio (ΔX) between pre- and post-treatment were calculated. Based on histologic response, the patients were divided into those with good response (≥ 90% necrosis, n = 12) and those with poor response (< 90% necrosis, n = 17). Several MRI parameters between the groups were compared using Student's t test. The correlation between image indexes and tumor necrosis was determined using Pearson's correlation, and diagnostic performance was compared using receiver operating characteristic curves. RESULTS: In good responders, MDpost, ADCpost, and MKpost values were significantly higher than in poor responders (p < 0.001, p < 0.001, and p = 0.042, respectively). The ΔMD and ΔADC were also significantly higher in good responders than in poor responders (p < 0.001 and p = 0.01, respectively). However, no significant difference was observed in ΔMK (p = 0.092). MDpost and ΔMD showed high correlations with tumor necrosis rate (r = 0.669 and r = 0.622, respectively), and MDpost had higher diagnostic performance than ADCpost (p = 0.037) and MKpost (p = 0.011). Similarly, ΔMD also showed higher diagnostic performance than ΔADC (p = 0.033) and ΔMK (p = 0.037). CONCLUSION: MD is a promising biomarker for monitoring tumor response to preoperative chemotherapy in patients with osteosarcoma.
Bone Neoplasms
;
Diffusion
;
Drug Therapy
;
Female
;
Humans
;
Magnetic Resonance Imaging
;
Male
;
Necrosis
;
Osteosarcoma
;
ROC Curve
;
Tumor Burden
10.Imaging manifestations and clinical diagnosis of phosphaturic mesenchymal tumor
Fangfang YAN ; Mengyu CHEN ; Zheyi CHEN ; Mei LI ; Weiwu YAO ; Fengling SHAN ; Qiong JIAO ; Qiang ZHENG
Chinese Journal of Radiology 2018;52(11):858-863
Objective To investigate the clinical and imaging characteristics of phosphaturic mesenchymal tumor and improve the clinical diagnosis. Methods From November 2014 to September 2017, 22 patients with pathologically confirmed diagnosis as phosphaturic mesenchymal tumor (PMT) were retrospectively analyzed, including 12 males and 10 females, age ranged from 30-72 years, mean (47 ± 11) years old. The clinical data, laboratory tests [serum calcium, phosphorus, alkaline phosphatase, parathyroid hormone and 1, 25- (OH) 2 D] and imaging examinations (X-ray, CT, MRI, nuclide) were collected and explored. Sixteen patients underwent SPECT scan and seven underwent PET/CT scan. Twenty patients had X-ray, eighteen patients had CT and 12 patients had MRI with enhancement. Results All patients suffered from diffuse pain for one to fifteen years, especially in lower back and lower extremities. All patients were found with low serum phosphorus, normal serum calcium. Twenty-one patients were found with elevated alkaline phosphatase, 16 with increased parathyroid hormone and 15 with decreased 1, 25 - (OH) 2 D. Thirteen lesions were located in the medullary cavity, seven in the soft tissue and two in the sinuses. Nineteen cases showed varying degrees of trabecular bone sparse, osteoporosis and osteomalacia on X-ray;There were 15 cases of multiple pseudo-fractures, including four cases of pelvic fracture complicated with femoral fracture, six cases of single fracture of pelvis, four cases of femur and one case of fibula. And seven cases showed multiple vertebral compression fractures. Thirteen lesions showed soft-tissue density and four in the medullary cavity showed high density on CT scan. The lesions presented low signal intensity on T1WI,high or low signal intensity on T2WI FLAIR and obviously enhanced in 12 patients who underwent MRI enhancement. Conclusion For patients with decreased serum phosphorus, elevated alkaline phosphatase, bone softening and fracture, octreotide or other nuclides should be primary imaging modality for confirming the location of the lesion. CT and MRI can further evaluate the nature of the lesion and improve diagnostic accuracy.

Result Analysis
Print
Save
E-mail