1.Research on the development of entrustable professional activity indicators for residents in China: a systematic review
Jingyu ZHONG ; Yue XING ; Liangjing LÜ ; Qinghua MIN ; Zhengguang XIAO ; Caisong ZHU ; Dandan SHI ; Xiaoyu FAN ; Jingshen CHU ; Huan ZHANG ; Yi JIANG ; Weiwu YAO
Chinese Journal of Medical Education Research 2025;24(6):728-735
Objective:To systematically evaluate the current status of research on the development of indicators for entrustable professional activities (EPAs) of residents in China.Methods:We searched the China National Knowledge Infrastructure, Wanfang Data, Airiti Library, PubMed, Embase, and Web of Science databases for literature on the development of EPA indicators for residents in China published between January 1, 2005 and February 28, 2025. Two researchers independently screened the literature and extracted data, followed by descriptive analysis. The quality of the studies was assessed using the Joanna Briggs Institute critical appraisal tool for expert opinion. Quantitative data were presented as medians (ranges) and qualitative data were presented as frequencies (percentages).Results:A total of eight articles were included, in which two general EPA indicator systems and six specialty-specific EPA indicator systems were developed for residents. The overall quality of the research was high, with the main shortcomings related to the methods used in the process of constructing the consensus indicators. The number of experts recruited ranged from 22 to 45, with 100.00% response rate, high authority coefficients (0.820-0.914), and high coordination coefficients (0.157-0.741). Most of the studies used literature reviews as one source for the indicator pool (8 studies, 100.00%), employed the Delphi method to reach consensus (6 studies, 75.00%), and provided inclusion criteria for the indicators (7 studies, 87.50%). However, only one study (12.50%) explored the practical application of the developed indicators, and none of the studies set indicator weights or conducted quality assessments. The number of EPA indicators developed ranged from 10 to 38 per study. The reporting of EPA indicators was included in most studies regarding titles (8 studies, 100.00%) and the expected levels of entrustment at various stages of training (6 studies, 75.00%), but the reporting on other aspects was lacking. Among the specialty-specific EPA indicators, 38.39% overlapped with the general EPAs indicators.Conclusions:The research on the development of EPA indicators for residents in China is still in its early stages, and there is room for improvement in methodological quality and reporting coverage. There is partial overlap between specialty-specific and general EPA indicators, failing to fully reflect the unique characteristics of different specialties.
2.Accuracy and quality of answer reasoning of Chinese large language model in Chinese middle level professional qualification examination of radiology
Jingyu ZHONG ; Yue XING ; Yangfan HU ; Qinghua MIN ; Caisong ZHU ; Dandan SHI ; Xiaoyu FAN ; Jingshen CHU ; Huan ZHANG ; Weiwu YAO
Chinese Journal of Medical Education Research 2025;24(2):145-149
Objective:To compare the accuracy of a Chinese large language model (LLM) and radiologists in Chinese middle level professional qualification examination of radiology, and evaluate the quality of answer reasoning provided by the Chinese LLM.Methods:In this study, 100 high-quality questions were selected using stratified random sampling to form a test set. We asked the ERNIE Bot by dialogues on the website to provide the correct answers and answer reasoning for these questions. These questions were also answered by 15 radiologists with different levels of experience. The accuracy of Chinese LLM and that of radiologists were compared. Two radiologists evaluated the quality of answer reasoning using a 5-point semi-quantitative scale.Results:The accuracy of ERNIE Bot was 60.00%, which was lower than the median (interquartile) accuracy of 67.00% (64.00%, 73.00%) for radiologists, and the difference was statistically significant ( W=2.47, P=0.013). The word count of the reasoning provided by Ernie Bot was (196.44±99.25) words, with no significant difference in word count between correct and incorrect answer reasoning, which were (211.03±107.53) words and (174.55±81.84) words, respectively ( t=1.82, P=0.072). Among the correct answers, the quality of reasoning was scored as follows: 1 point for 3 questions, 2 points for 9 questions, 3 points for 12 questions, and 4 points for 36 questions. No reasoning received a score of 5. Conclusions:Chinese LLM demonstrates a certain level of medical knowledge and clinical reasoning ability, which can assist clinical teachers in educational activities. However, it is not yet able to independently tutor residents and lacks the ability of invitational and heuristic teaching.
3.An investigation of the current status of Chinese-foreign cooperative education programs for medical majors
Jingyu ZHONG ; Yue XING ; Qinghua MIN ; Zhengguang XIAO ; Caisong ZHU ; Dandan SHI ; Xiaoyu FAN ; Jingshen CHU ; Huan ZHANG ; Yi JIANG ; Weiwu YAO
Chinese Journal of Medical Education Research 2025;24(5):577-582
Objective:To investigate the current status of Chinese-foreign cooperative education programs for medical majors, and to discuss the potential problems and development trends of this field.Methods:Related data were collected from the information platform of Chinese-Foreign Cooperation in Running Schools by Ministry of Education of the People's Republic of China, and the characteristics of Chinese-foreign cooperative education programs for medical majors were extracted for analysis. Categorical data were expressed as frequency (percentage), and continuous data were expressed as mean±standard deviation.Results:A total of 83 Chinese-foreign cooperative education programs for medical majors were included in the study, accounting for only 3.45% (83/2 406) of all programs. Chinese partners in these cooperative programs were mainly from East China (41 programs, 49.40%), while foreign partners were mainly from Europe (39 programs, 46.99%). The mean duration of these programs was (3.61±0.88) years, with an enrollment of (87.08±35.52) students. Most of the students were included in National General Higher Education Enrollment Plan (79 programs, 95.18%), and the main majors included nursing (39 programs, 46.99%), medical technology (19 programs, 22.89%), and clinical medicine (11 programs, 13.25%), with the main enrollment level of junior college (45 programs, 54.22%). Chinese partners in the cooperative programs mainly issued academic certificate (45 programs, 54.22%) or academic certificate plus degree certificate (36 programs, 43.37%), while most foreign partners did not issue such certificates (44 programs, 53.01%).Conclusions:There are several problems in Chinese-foreign cooperative education programs for medical majors, such as a limited number of programs, a significant regional difference, an imbalanced distribution of specialties, a low level of education, and inconsistency in issuance of certificates, which still requires further improvement and standardization. However, there are also high-level and high-quality programs for reference.
4.Research on the development of entrustable professional activity indicators for residents in China: a systematic review
Jingyu ZHONG ; Yue XING ; Liangjing LÜ ; Qinghua MIN ; Zhengguang XIAO ; Caisong ZHU ; Dandan SHI ; Xiaoyu FAN ; Jingshen CHU ; Huan ZHANG ; Yi JIANG ; Weiwu YAO
Chinese Journal of Medical Education Research 2025;24(6):728-735
Objective:To systematically evaluate the current status of research on the development of indicators for entrustable professional activities (EPAs) of residents in China.Methods:We searched the China National Knowledge Infrastructure, Wanfang Data, Airiti Library, PubMed, Embase, and Web of Science databases for literature on the development of EPA indicators for residents in China published between January 1, 2005 and February 28, 2025. Two researchers independently screened the literature and extracted data, followed by descriptive analysis. The quality of the studies was assessed using the Joanna Briggs Institute critical appraisal tool for expert opinion. Quantitative data were presented as medians (ranges) and qualitative data were presented as frequencies (percentages).Results:A total of eight articles were included, in which two general EPA indicator systems and six specialty-specific EPA indicator systems were developed for residents. The overall quality of the research was high, with the main shortcomings related to the methods used in the process of constructing the consensus indicators. The number of experts recruited ranged from 22 to 45, with 100.00% response rate, high authority coefficients (0.820-0.914), and high coordination coefficients (0.157-0.741). Most of the studies used literature reviews as one source for the indicator pool (8 studies, 100.00%), employed the Delphi method to reach consensus (6 studies, 75.00%), and provided inclusion criteria for the indicators (7 studies, 87.50%). However, only one study (12.50%) explored the practical application of the developed indicators, and none of the studies set indicator weights or conducted quality assessments. The number of EPA indicators developed ranged from 10 to 38 per study. The reporting of EPA indicators was included in most studies regarding titles (8 studies, 100.00%) and the expected levels of entrustment at various stages of training (6 studies, 75.00%), but the reporting on other aspects was lacking. Among the specialty-specific EPA indicators, 38.39% overlapped with the general EPAs indicators.Conclusions:The research on the development of EPA indicators for residents in China is still in its early stages, and there is room for improvement in methodological quality and reporting coverage. There is partial overlap between specialty-specific and general EPA indicators, failing to fully reflect the unique characteristics of different specialties.
5.Accuracy and quality of answer reasoning of Chinese large language model in Chinese middle level professional qualification examination of radiology
Jingyu ZHONG ; Yue XING ; Yangfan HU ; Qinghua MIN ; Caisong ZHU ; Dandan SHI ; Xiaoyu FAN ; Jingshen CHU ; Huan ZHANG ; Weiwu YAO
Chinese Journal of Medical Education Research 2025;24(2):145-149
Objective:To compare the accuracy of a Chinese large language model (LLM) and radiologists in Chinese middle level professional qualification examination of radiology, and evaluate the quality of answer reasoning provided by the Chinese LLM.Methods:In this study, 100 high-quality questions were selected using stratified random sampling to form a test set. We asked the ERNIE Bot by dialogues on the website to provide the correct answers and answer reasoning for these questions. These questions were also answered by 15 radiologists with different levels of experience. The accuracy of Chinese LLM and that of radiologists were compared. Two radiologists evaluated the quality of answer reasoning using a 5-point semi-quantitative scale.Results:The accuracy of ERNIE Bot was 60.00%, which was lower than the median (interquartile) accuracy of 67.00% (64.00%, 73.00%) for radiologists, and the difference was statistically significant ( W=2.47, P=0.013). The word count of the reasoning provided by Ernie Bot was (196.44±99.25) words, with no significant difference in word count between correct and incorrect answer reasoning, which were (211.03±107.53) words and (174.55±81.84) words, respectively ( t=1.82, P=0.072). Among the correct answers, the quality of reasoning was scored as follows: 1 point for 3 questions, 2 points for 9 questions, 3 points for 12 questions, and 4 points for 36 questions. No reasoning received a score of 5. Conclusions:Chinese LLM demonstrates a certain level of medical knowledge and clinical reasoning ability, which can assist clinical teachers in educational activities. However, it is not yet able to independently tutor residents and lacks the ability of invitational and heuristic teaching.
6.An investigation of the current status of Chinese-foreign cooperative education programs for medical majors
Jingyu ZHONG ; Yue XING ; Qinghua MIN ; Zhengguang XIAO ; Caisong ZHU ; Dandan SHI ; Xiaoyu FAN ; Jingshen CHU ; Huan ZHANG ; Yi JIANG ; Weiwu YAO
Chinese Journal of Medical Education Research 2025;24(5):577-582
Objective:To investigate the current status of Chinese-foreign cooperative education programs for medical majors, and to discuss the potential problems and development trends of this field.Methods:Related data were collected from the information platform of Chinese-Foreign Cooperation in Running Schools by Ministry of Education of the People's Republic of China, and the characteristics of Chinese-foreign cooperative education programs for medical majors were extracted for analysis. Categorical data were expressed as frequency (percentage), and continuous data were expressed as mean±standard deviation.Results:A total of 83 Chinese-foreign cooperative education programs for medical majors were included in the study, accounting for only 3.45% (83/2 406) of all programs. Chinese partners in these cooperative programs were mainly from East China (41 programs, 49.40%), while foreign partners were mainly from Europe (39 programs, 46.99%). The mean duration of these programs was (3.61±0.88) years, with an enrollment of (87.08±35.52) students. Most of the students were included in National General Higher Education Enrollment Plan (79 programs, 95.18%), and the main majors included nursing (39 programs, 46.99%), medical technology (19 programs, 22.89%), and clinical medicine (11 programs, 13.25%), with the main enrollment level of junior college (45 programs, 54.22%). Chinese partners in the cooperative programs mainly issued academic certificate (45 programs, 54.22%) or academic certificate plus degree certificate (36 programs, 43.37%), while most foreign partners did not issue such certificates (44 programs, 53.01%).Conclusions:There are several problems in Chinese-foreign cooperative education programs for medical majors, such as a limited number of programs, a significant regional difference, an imbalanced distribution of specialties, a low level of education, and inconsistency in issuance of certificates, which still requires further improvement and standardization. However, there are also high-level and high-quality programs for reference.
7.Interpretation of the radiologist training system in Canada and enlightenment
Jingyu ZHONG ; Yue XING ; Yangfan HU ; Defang DING ; Xianwei LIU ; Qinghua MIN ; Zhengguang XIAO ; Caisong ZHU ; Dandan SHI ; Xiaoyu FAN ; Jingshen CHU ; Huan ZHANG ; Weiwu YAO
Chinese Journal of Medical Education Research 2024;23(9):1210-1216
This paper aims to discuss the ideas and experience about the radiology residency training system of Canada with a presentation of its base accreditation standards for five aspects, competency goals for seven roles, four stages of training arrangement, and two types of final assessment questions. Although the Canada's radiology residency program differs from China's standardized resident and specialist training programs for radiology, there are still several points that are worth referencing, including emphasizing the training priority of competency goals, providing a specific basis for the stratification of training, offering clear guidance for the implementation of training content, and improving assessment methods to focus on competency goals. These points are of great value for improving the standardized radiology resident and specialist training programs in China, so as to provide a reference for the training of excellent radiologists in China.
8.Application of Eurorad database in the teaching of radiology in standardized residency training: A case study of teaching film-reading
Jingyu ZHONG ; Qinhua MIN ; Caisong ZHU ; Zhenmin JIANG ; Yifan WANG ; Huan ZHANG ; Weiwu YAO
Chinese Journal of Medical Education Research 2024;23(1):134-139
The teaching of radiology in standardized residency training needs a large number of case data to strengthen the subjective understanding and awareness of residents. The database built by residency training bases can meet the needs of teaching to a certain extent, but the conditions of training bases vary across regions, which makes it difficult to achieve homogeneity in the teaching of radiology. This article discusses the application of Eurorad database in the teaching of radiology in standardized residency training. This database is free of charge, reliable, and comprehensive and provides a large number of free reliable cases and images for teaching, covering both common and rare diseases. Moreover, it can also be used to cultivate the English ability and comprehensive quality of residents and help to establish a hierarchical training system for radiology and non-radiology residents, thereby promoting the improvement in the quality of standardized residency training. This article shows the potential value of Eurorad database in the teaching of radiology in standardized residency training, and comparative studies are needed in the future to further prove its effectiveness.
9.The role of diffusion-weighted imaging for breast MRI
Qinghua MIN ; Jun YANG ; Kangwei SHAO ; Caisong ZHU ; Lixin YUAN ; Huiling XU ; Peng LI ; Wenjie LU
China Oncology 2015;(8):602-607
Background and purpose:Diffusion-weighted imaging (DWI) is a non-invasive technique of breast magnetic resonance imaging (MRI). DWI is an alternative to dynamic contrast-enhanced (DCE) MRI for differentiating malignant from benign lesions in breast screening or not. This study aimed to evaluate the potential role of DWI in differentiating malignant breast lesions from benign lesions.Methods:Seventy-four patients underwent digital mammography, DCE and DWI (49 patients’b-value of 0, 400, 600 and 800 s/mm2). The detectability, sensitivity and speciifcity of DWI and DCE were compared. Absolute apparent diffusion coefifcient (ADC) was compared with standardized ADC for quantitative analysis.Results:Sixty-four of 74 patients had positive pathologic findings (38 malignant, 26 benign). All of the malignant lesions were detected on DWI and DCE. The sensitivity of DWI was 83.33%, 90.00% and 93.33%, and the specificity was 85.91%, 76.19% and 72.72%, forb-value of 400, 600 and 800 s/mm2, respectively. The sensitivity and speciifcity of DCE were 86.61% and 90.48%. There was no signiifcant difference between absolute and standardized ADC in detecting breast cancer (P>0.05).Conclusion:DWI is an important complemented technique to DCE-MRI for differentiating malignant from benign lesions in breast MRI.
10.Comparison of 1.5T and 3.0T diffusion-weighted imaging in the application of the complex adnexal masses in female patients
Caisong ZHU ; Quanyong LUO ; Weiwu YAO ; Jun YANG ; Jing YANG ; Kangwei SHAO ; Wei LIU ; Hairong CHEN ; Lixin YUAN
Journal of Practical Radiology 2015;(5):792-796
Objective To compare signal characteristics and image qualities of MR diffusion-weighted imaging (DWI)at 1.5T and 3.0T in patients with the complex adnexal masses.Methods Magnetic resonance imaging including routine MRI and DWI(b=0 s/mm2 ,400 s/mm2 , 600 s/mm2 ,800 s/mm2 ,1 000 s/mm2 )of 1.5T (50 patients with 31 benign and 1 9 malignant lesions )and 3.0T (53 patients with 29 benign and 24 malignant lesions )were performed in 103 patients with histopathologically proved adnexal masses.The optimal b value was analyzed,and the apparent diffusion coefficient (ADC)value and signal intensity (SI)value and contrast to noise ratio (CNR)of solid and cystic components in adnexal masses from both 1.5T and 3.0T MR were respectively compared statistically.Results The 800 s/mm2 was the optimal b value in demonstrating adnexal masses at 1.5T and 3.0T.The CNR of solid and cystic components in adnexal masses were significantly higher at 3.0T than at 1.5T on all b values(all P =0.000).The difference in ADC value of solid lesions between 1.5T and 3.0T on all b values DWI had no statistically significant (all P >0.05),nor did the difference in SI value of solid lesions as well as ADC value of cystic lesions on b800 DWI(P >0.05).Conclusion MR diffusion-weighted imaging at 3.0T compared with 1.5T has quantitative and qualitative advantages of evaluating for adnexal masses,while the 800 s/mm2 is the optimal b value for both of them.

Result Analysis
Print
Save
E-mail