Exploration, practice, and implications of evaluating the implementation quality of scenario-based simulation courses
10.3760/cma.j.cn116021-20240808-02117
- VernacularTitle:情境模拟课程实施质量评价工作的探索实践和启示
- Author:
Jiayu WANG
1
;
Lingling XU
;
Zhehan JIANG
;
Ting SHI
Author Information
1. 上海交通大学医学院附属瑞金医院医学教育处，上海 200025
- Publication Type:Journal Article
- Keywords:
Scenario-based simulation;
Course implementation;
Teaching ability
- From:
Chinese Journal of Medical Education Research
2025;24(9):1188-1193
- CountryChina
- Language:Chinese
-
Abstract:
Objective:To explore the construction of an assessment tool for the implementation of scenario-based simulation courses, and provide a reference for the standardized implementation of scenario-based simulation courses and the key direction of teacher training.Methods:Based on the elements of the implementation of scenario-based simulation courses, the Scenario-Based Simulation Course Implementation Quality Scale was developed through expert interviews and expert panel meetings. This scale was used to rate the implementation of scenario-based simulation courses by 12 teaching teams in Shanghai, China. The evaluation scores were collected and analyzed using R language.Results:The reliability of the evaluation scale was assessed using Cronbach's α (0.893) and inter-rater consistency was assessed using the intraclass correlation coefficient (0.226). Among the 12 teaching teams, the lowest score rate was 67.07% for "debriefing". A correlation analysis between scenario-based simulation teaching design and course implementation showed a Pearson correlation coefficient r of -0.08 ( P=0.809), which indicated no significant correlation between them. Conclusions:The assessment of the implementation of scenario-based simulation courses should include all aspects of course implementation. The rater's understanding of scenario-based simulation courses can affect the results. Debriefing remains a challenge in implementing scenario-based simulation courses. A comprehensive assessment of the teaching ability of simulation teaching teams should include both teaching design and course implementation.
