Korean Journal of Medical Education 2005;17(2):197-203
Standardized Patients' Accuracy in Recording Checklist Items during Clinical Performance Examinations.
Jwa Seop SHIN 1 ; Seong A LEE ; Hoonki PARK
Affiliations
Keywords
Clinical performance; Observer variation; Educational measurement
Country
Republic of Korea
Language
Korean
MeSH
ACTIONS
ACTIONS
ACTIONS
ACTIONS
ACTIONS
Abstract
PURPOSE: Standardized patients participate in clinical performance examinations not only to simulate case scenarios but also to evaluate the performance of students using a checklist. The accuracy in checking off checklist items is one of the most important factors determining the reliability of this examination. The purposes of this study were to determine the SP' s overall accuracy in recording checklist items, and whether their accuracy was affected by certain characteristics of checklist items. METHODS: Three professors, who have been fully involved in scenario development and SP training, reviewed videotapes of the examination and evaluated the performance of the students using the same checklist. SP' s checklists were marked on this 'correct checklist'. The checklists and checklist guidelines of the items marked under the score of 50 out of 100 were analyzed. RESULTS: Results showed that the accuracy of the SP' s in recording checklist items was 86.9% and was affected by certain characteristics, such as complexity or ambiguity of checklists and checklist guidelines. CONCLUSION: In this study, the SP' s accuracy in recording checklist items was good to very good, and the result suggested that the accuracy could be improved by the elaboration of checklists and checklist guidelines.
备案号: 11010502037788, 京ICP备10218182号-8)