PURPOSE: A high degree of agreement between standardized patients (SP) check-list recordings and those of faculty will be necessary if SPs are to eventually replace faculties in the OSCE evaluaton process. This study was conducted to know to what degree SPs' checklist recordings agree with those of faculties during an OSCE. METHODS: One hundred and twenty one fourth-year medical students of Hanyang University College of Medicine took an OSCE. In each of two study stations, a student saw an SP for four minutes and the SP recorded the same checklists as a faculty examiner did, for the following fifty seconds. RESULTS: For the 'bad news delivery' station, SP evaluations were more lenient compared to those of faculties (56 vs 45, p< 0.01), but in the case of 'chest pain', there was no significant difference. Pearson correlation coefficients for the 'bad news delivery' station and for the 'chest pain' case were 0.60 and 0.65, respectively. The mean percentages of agreement for the 'bad news delivery' and the 'chest pain' checklists were 71% and 82%, respectively. The mean kappa statistics for the 'bad news delivery' and the 'chest pain' check-lists were 0.19 and 0.49, respectively. CONCLUSION: The ratings by SPs were found to be consistent with those of faculties only in moderate degree. The exactness of scoring criteria, and the optimal SP training are to be the premise for the replacement of faculties by SPs during OSCE checklist recordings.
Checklist* ; Clinical Competence ; Educational Measurement ; Humans ; Observer Variation ; Patient Simulation ; Students, Medical