Massive open online course (MOOC) is a new learning model, which integrates the progress of novel educational concepts and the breakthrough of information technology. MOOC uses new web-based tools and online-environments to deliver knowledge education and lecture classes in a new paradigm. In this paper, we firstly reviewed the achievements through four stages of the construction and development of online courses of physiology in China in the past 20 years. Then, taking the physiology MOOC at Central South University of China as an example, we introduced the specific practices and experiences to construct the online physiological open course, including the online open course-based offline and online flipped classroom teaching practice. Finally, we discussed several important issues during the construction and application of online open courses, aiming to provide practical information for other universities.
Asian Continental Ancestry Group ; China ; Education, Distance ; Educational Measurement ; Humans ; Universities

Formative assessment aims at cultivating and improving students' comprehensive qualities and abilities. It acquires and analyzes the dynamic changes of students' learning process through flexible and diverse assessment methods. The assessment contents cover multiple aspects including knowledge, abilities, attitudes, literacy, etc., which help teachers and students to formulate practical and efficient improvement strategies and to meet the inherent needs of students for comprehensive development. This review describes the connotation of formative assessment and summarizes its application in higher education of basic medical science in China. The existing shortcomings and the reasonable advice are proposed. We also introduce our experience in the application of formative assessment in pathophysiology education. This review will provide reference and enlightenment for the reform and innovation of the assessment system in higher education of basic medical science.
China ; Education, Medical ; Educational Measurement ; Humans

Summative assessment plays a decisive role in the educational assessment system, which is a yardstick to measure the cultivating goal of higher education. The rapid progress of modern society has put forward higher standard for higher medical education. Traditional summative assessment system with single dimension that focuses on evaluating the student's learning outcome via a standardized examination cannot meet the higher requirements for undergraduate medical education. We have improved the summative assessment system by optimizing the assessment content, criteria and method, as well as teachers' assessment skills and students' evaluation. The reform greatly increases the teaching quality and learning effect in our university.
Education, Medical ; Education, Medical, Undergraduate ; Educational Measurement ; Humans ; Learning ; Students, Medical

PURPOSE: Test equating studies in medical education have been conducted only for high-stake exams or to compare two tests given in a single course. Based on item response theory, we equated computer-based test (CBT) results from the basic medical education curriculum at the College of Medicine, the Catholic University of Korea and evaluated the validity of using fixed passing scores. METHODS: We collected 232 CBTs (28,636 items) for 40 courses administered over a study period of 9 years. The final data used for test equating included 12 pairs of tests. After test equating, Wilcoxon rank-sum tests were utilized to identify changes in item difficulty between previous tests and subsequent tests. Then, we identified gaps between equated passing scores and actual passing scores in subsequent tests through an observed-score equating method. RESULTS: The results of Wilcoxon rank-sum tests indicated that there were no significant differences in item difficulty distribution by year for seven pairs. In the other five pairs, however, the items were significantly more difficult in subsequent years than in previous years. Concerning the gaps between equated passing scores and actual passing scores, equated passing scores in 10 pairs were found to be lower than actual passing scores. In the other two pairs, equated passing scores were higher than actual passing scores. CONCLUSION: Our results suggest that the item difficulty distributions of tests taught in the same course during successive terms can differ significantly. It may therefore be problematic to use fixed passing scores without considering this possibility.
Curriculum ; Education, Medical ; Educational Measurement ; Korea ; Methods

PURPOSE: The spotter's (objectively structured practical examination) is an assessment tool which is widely used to test the practical knowledge of anatomy extensively. In Indian context it is used as an inclusive model in the gross anatomy practical examination and the marks allotted to it varies. The traditional spotter examination often has been blamed for only incorporating the initial levels of revised Bloom's taxonomy. This study retrospectively analysed the pre-professional spotter's examination score and tested its efficacy in terms of reliability, internal consistency, validity, educational impact, and resource intensiveness. METHODS: The summative data of student's score on four different days of unrepeated spotter's examination and final theory examination score was collected and tabulated. These four group of students acted as independent cohorts. The difficulty index (DI), point biserial correlation (PBC), Cronbach α (CA) and descriptive statistics of each cohort were calculated. Revised bloom taxonomy rating was applied to spotter's. RESULTS: We found heterogenous distribution of spotter's in each cohort according to DI. The PBCs and CA of each cohort were acceptable. The majority of spotter's tested the cognitive and comprehension domain of revised bloom's taxonomy. There was nonsignificant difference between mean scores of cohorts but we found low positive significant correlation between theory and spotter's score. CONCLUSION: We concluded that the construct of spotter's was reliable, internally consistent, had fair validity, variable educational impact, and sustainable resource intensiveness. We propose urgent redesigning of spotter's to include higher level of taxonomy to comply with emerging curricular changes.
Classification ; Cognition ; Cohort Studies ; Comprehension ; Curriculum ; Educational Measurement ; Humans ; Retrospective Studies

PURPOSE: Assessment in different languages should measure the same construct. However, item characteristics, such as item flaws and content, may favor one test-taker group over another. This is known as item bias. Although some studies have focused on item bias, little is known about item bias and its association with items characteristics. Therefore, this study investigated the association between item characteristics and bias. METHODS: The University of Groningen offers both an international and a national bachelor’s program in medicine. Students in both programs take the same progress test, but the international progress test is literally translated into English from the Dutch version. Differential item functioning was calculated to analyze item bias in four subsequent progress tests. Items were also classified by their categories, number of alternatives, item flaw, item length, and whether it was a case-based question. RESULTS: The proportion of items with bias ranged from 34% to 36% for the various tests. The number of items and the size of their bias was very similar in both programmes. We have identified that the more complex items with more alternatives favored the national students, whereas shorter items and fewer alternatives favored the international students. CONCLUSION: Although nearly 35% of all items contain bias, the distribution and the size of the bias were similar for both groups. The findings of this paper may be used to improve the writing process of the items, by avoiding some characteristics that may benefit one group whilst being a disadvantage for others.
Bias (Epidemiology) ; Education, Medical ; Educational Measurement ; Humans ; Writing

Although ‘assessment for learning’ rather than ‘assessment of learning’ has been emphasized recently, student learning before examinations is still unclear. The purpose of this study was to investigate pre-assessment learning activities (PALA) and to find mechanism factors (MF) that influence those activities. Moreover, we compared the PALA and MF of written exams with those of the clinical performance examination/objective structured clinical examination (CPX/OSCE) in third-year (N=121) and fourth-year (N=108) medical students. Through literature review and discussion, questionnaires with a 5-point Likert scale were developed to measure PALA and MF. PALA had the constructs of cognitive and meta-cognitive activities, and MF had sub-components of personal, interpersonal, and environmental factors. Cronbach's α coefficient was used to calculate survey reliability, while the Pearson correlation coefficient and multiple regression analysis were used to investigate the influence of MF on PALA. A paired t-test was applied to compare the PALA and MF of written exams with those of CPX/OSCE in third and fourth year students. The Pearson correlation coefficients between PALA and MF were 0.479 for written exams and 0.508 for CPX/OSCE. MF explained 24.1% of the PALA in written exams and 25.9% of PALA in CPX/OSCE. Both PALA and MF showed significant differences between written exams and CPX/OSCE in third-year students, whereas those in fourth-year students showed no differences. Educators need to consider MFs that influence the PALA to encourage 'assessment for learning'.
Education, Medical, Undergraduate ; Educational Measurement ; Humans ; Learning ; Students, Medical

The Dr. LEE Jong-wook—Seoul Project (DLSP) in the Lao People'0s Democratic Republic (PDR) is a long-term development cooperation initiative aimed at upgrading the medical education capacity at the University of Health Sciences (UHS) in the Lao PDR. Under the project, eight faculty members from UHS were trained at the Seoul National University College of Medicine for a 12-month period during 2010–2011. Using a training-of-trainers model, we estimated the effect of DLSP on the learning outcomes of students, which was measured using the standard test scores of the students. The questionnaire developed by the Medical Education Assessment Consortium in Korea was given to the students and both the percent-correct and standardized scores were examined. The evaluation strategy was to compare the learning outcomes of the students taught by the trainees with those that were not and to compare the medical topics taught by the trainees with other topics. It was found that the first group of trainees in the DLSP was associated with an increase of 1.5 in the percent-correct test scores for basic medicine. While the interpretation requires caution, it is consistent with the view that a training program for faculty members could be effective in improving the teaching capacity of medical schools in developing countries.
Developing Countries ; Education ; Education, Medical ; Educational Measurement ; Humans ; Korea ; Laos ; Learning ; Schools, Medical ; Seoul ; Students, Medical

BACKGROUND: The clinical practice examination (CPX) was introduced in 2010, and the Seoul-Gyeonggi CPX Consortium developed the patient-physician interaction (PPI) assessment tool in 2004. Both institutions use rating scales on classified sections of PPI but differ in their scoring of key components. This study investigated the accuracy of standardized patient scores across rating scales by comparing checklist methods and verified the concurrent validity of two comparable PPI rating tools. METHODS: An educational CPX module dyspepsia case was administered to 116 fourth-year medical students at Hanyang University College of Medicine. One experienced standardized patient rated exams using two different PPI scales. She scored checklists composed of 43 items related to the two original PPI scales through video clips of the same students. From these checklists, we calculated Pearson's correlation coefficient. RESULTS: The correlations of total PPI score between the checklist and rating scale methods were 0.29 for the Korean Medical Licensing Examination (KMLE) tool and 0.30 for the consortium tool. The correlations between the KMLE and consortium tools were 0.74 for checklists and 0.83 for rating scales. In terms of section scores, the consortium tool showed only three significant correlations between the two methods out of seven sections and the KMLE tool showed only two statistically significant correlations out of five sections. CONCLUSION: The rating scale and checklist methods exhibited a weak relationship in the PPI assessment, but a high correlation between assessment tools using the same method. However, the current rating scale requires modification by reorganizing key scoring components through factor analysis.
Behavior Rating Scale ; Checklist* ; Dyspepsia ; Education, Medical ; Educational Measurement ; Humans ; Licensure ; Methods ; Physician-Patient Relations ; Students, Medical ; Weights and Measures

PURPOSE: This study aims to develop a system of course monitoring by students and evaluate the course quality management system (CQMS) implemented as an educational assessment tool. METHODS: This research was conducted in accordance with the ADDIE model which is a well-known instructional design model. The ADDIE process includes needs analysis, design of the course monitoring and course evaluation, development of evaluation forms, implementation of course monitoring, and evaluation of the program. RESULTS: To meet the need for a system that can replace the traditional lecture evaluation approach, this study developed and implemented a new course evaluation system. In comparison with the quantitative evaluation method, course monitoring by students provided more qualitative information on classes and courses from the students' perspective. The students' realistic description helped know how student felt the atmosphere of class and what kinds of teaching style students preferred. However, some view that the evaluation by the four monitoring members was less reliable. CONCLUSION: This study proposed a course quality management based on students' monitoring which emphasized the narrative evaluation to help to identify the strengths and weaknesses of the classes and gather qualitative information from the students' perspective that can be used to improve the courses. It is expected that providing the monitoring members with better orientation could help manage the quality of the courses using the monitoring system.
Atmosphere ; Educational Measurement ; Evaluation Studies as Topic ; Humans ; Methods ; Schools, Medical*