Value of annual professional proficiency test results in predicting the theoretical examination score of completion assessment in standardized residency training
10.3760/cma.j.cn116021-20230312-01562
- VernacularTitle:住院医师规范化培训年度业务水平测试结果对结业考核理论考试的预测作用
- Author:
Lei YAO
1
;
Xiaoqin HUANG
;
Lu YUAN
;
Chunqin FAN
;
Shimin TANG
;
Jieyu LU
Author Information
1. 南通大学第二附属医院教育培训处，南通 226001
- Keywords:
Standardized residency training;
Annual professional proficiency test;
Completion assessment;
Predictive value
- From:
Chinese Journal of Medical Education Research
2024;23(1):17-21
- CountryChina
- Language:Chinese
-
Abstract:
Objective:To investigate the correlation between the annual professional proficiency test results and the theoretical examination score of completion assessment in standardized residency training, as well as the value of the annual professional proficiency test results in predicting whether a resident passes the theoretical examination of completion assessment.Methods:The residents who participated in the annual professional proficiency test of residency training in Affiliated Hospital 2 of Nantong University in 2019-2021 and the completion assessment of residency training in 2020-2022 were selected as subjects, and related data were collected, including sex, education background, personnel type, training specialty, the results of annual professional proficiency test, and the theoretical examination score of completion assessment. According to whether the resident passed the theoretical examination of completion assessment, they were divided into passed group and failed group. SPSS 19.0 was used to perform the chi-square test, the independent samples t-test, and the binary logistic regression analysis; the Pearson correlation coefficient was used for correlation analysis; the sensitivity analysis was represented by ROC curve. Results:Compared with the residents who passed the theoretical examination of completion assessment, the residents who did not pass the examination had a significant reduction in the proportion of the residents from our hospital and a significant increase in the proportion of the residents commissioned by foreign institutions ( χ 2=7.00, P=0.008). The passed group had a significantly higher national percentile of annual professional proficiency test score than the failed group (43.46%±26.61% vs. 23.40%±18.71%, t=6.02, P<0.001). The national percentile of annual professional proficiency test score was positively correlated with the theoretical examination score of completion assessment ( r=0.43, P<0.05). The source of residents commissioned by foreign institutions and the low percentile of annual professional proficiency test score were independent risk factors for failing the theoretical examination of completion assessment ( P=0.020 and P<0.001). The national percentile of annual professional proficiency test score had an area under the ROC curve of 0.73 (95% CI: 0.65-0.80) in predicting the outcome of theoretical examination and had a certain predictive value with a cut-off value of 15.1%. Conclusions:In addition to strengthening homogenization and professional base management for residency training, it is necessary to make full use of the results of annual professional proficiency test in standardized residency training and timely check the professional knowledge of the residents whose a national percentile of <15.1%, so as to effectively improve the pass rate of theoretical examination and the quality of training.
