Analysis and Assessment of a Large-Scale Traditional Chinese Medicine Examination Based on Cognitive Diagnostic
10.13288/j.11-2166/r.2024.22.017
- VernacularTitle:大规模中医师考试评价中认知诊断模型的构建及应用
- Author:
Zhehan JIANG
1
;
Lingling XU
2
;
Shucheng PAN
3
;
A'ning JIN
1
Author Information
1. Chinese Medicine Qualification Center of the National Administration of Traditional Chinese Medicine，Beijing，100029
2. National Center for Health Professions Education Development，Peking University
3. School of Nursing，Peking University
- Publication Type:Journal Article
- Keywords:
qualification examination for traditional Chinese medicine practitioners;
competence of traditional Chinese medicine practitioners;
cognitive diagnosis;
traditional Chinese medicine education;
standardized test
- From:
Journal of Traditional Chinese Medicine
2024;65(22):2383-2388
- CountryChina
- Language:Chinese
-
Abstract:
ObjectiveTo analyze the scores of the second-tier assessment on theory of competency of Traditional Chinese Medicine （TCM） physicians based on cognitive diagnostic model， and to provide a reference for cognitive diagnostic studies of large-scale medical examinations. MethodsCognitive diagnostic analyses were conducted by selecting the responses of 16，310 candidates who took the theory examination of the second-tier assessment on the competency of TCM physicians in 2023. The degree of fit between the topological deterministic input noise and gate model （G-DINA model） and the examination data was examined； item parameter analysis and reliability analysis were conducted under the cognitive diagnostic framework； the candidates' mastery of cognitive attributes was comprehensively analysed at different levels. ResultsThe mean score of 16，310 candidates in this study was （189.76 ± 40.86）， and a total of 9，994 candidates passed this examination， with a pass rate of 61.28 %. The total number of questions in the examination was 300， and among the five modules， the frequency of assessment of TCM fundamentals was the highest （132 questions， 44%）， followed by TCM clinic （87 questions， 29%）， Western medicine fundamentals （60 questions， 20%）， and TCM classics （12 questions， 4%） and medical humanities （9 questions， 3%） was less. The results of the model fit index showed that the area under the curve （AUC） of the G-DINA model was 0.98， indicating that the model fit the study data excellently. The results of item parameter analysis showed that all the discriminations of the cognitive diagnostic model for the 300 test questions were greater than 0， with an average discrimination of 0.25， and the overall performance of the question discriminations was good. The results of the reliability analysis showed that the test level classification accuracy was 0.75， and the attribute level classification accuracy was 0.83 to 0.99， indicating that the G-DINA model has high attribute classification accuracy. The results of the cognitive diagnostic analyses showed that the proportion of candidates who had passed the exam was higher for the cognitive attributes of each module compared to those who had not passed the exam. ConclusionThe analysis of large-scale TCM examinations based on cognitive diagnosis can provide support for improving the quality of TCM talent education and cultivation.
