Examination of the Reproducibility of Nationwide Clinical Resident Evaluation Forms Launched in FY 2020 -Using National Resident Evaluation Data-
10.11307/mededjapan.55.4_342
- VernacularTitle:2020年度全国で開始した臨床研修医評価票の再現性の検討―全国の研修医評価データを用いて―
- Author:
Takako MORITA
1
;
Sachiko OHDE
1
;
Tsuguya FUKUI
2
Author Information
1. Graduate School of Public Health St. Luke's International University
2. Tokyo Medical University Ibaraki Medical Centre
- Keywords:
clinical residency training system;
evaluation forms;
clinical resident;
reproducibility
- From:Medical Education
2024;55(4):342-347
- CountryJapan
- Language:Japanese
-
Abstract:
Introduction: This study analyzed the reproducibility of residency training evaluation forms revised in FY 2020 using EPOC2. Methods: Reproducibility was assessed by calculating the concordance rate and intraclass correlation coefficient (ICC) between evaluations from two clinical educators during the same clinical department rotation. Additionally, Bland-Altman plots were created to visualize the data. Results: Out of 13,184 residents at facilities using EPOC2, approximately 3,800 who were evaluated more than twice by clinical educators during the same training period were analyzed. The average concordance rates for items A, B, and C were 68.6%, 43.8%, and 57.6%, respectively, indicating variability in evaluations among clinical educators. ICC values were also low. Discussion: Our findings suggest that the reproducibility of evaluations was low and discrepancies among clinical educators’ assessments were evident. To improve reproducibility, we recommend increasing the number of evaluations by different clinical educators and strengthening clinical educator workshops.
