1.Beyond the surface: unraveling global health curriculum insights through interviews of learners and educators using the CIPP model
Yoonjung LEE ; Jayoung PARK ; Woong-Han KIM ; Jwa-Seop SHIN ; Hyun Bae YOON
Korean Journal of Medical Education 2024;36(1):41-50
Purpose:
Our study aimed to delve beyond a surface-level understanding and explore the various dimensions of the global health curriculum from the perspective of both learners and educators using the Context, Input, Process, and Product (CIPP) model.
Methods:
From 2020 to 2021, interviews were conducted with a total of 10 individuals, including five students who had taken at least one elective course and at least one elective research course, three teaching assistants (TA), and two faculty members who had taken more than four global health courses in multiple phases in the global health curriculum. Semi-structured interview questions based on the CIPP model were used and qualitative data were analyzed through content analysis.
Results:
The study identified 12 sub-themes. Students held idealized views of global health careers and sought to bridge the gap through global health classes. They desired early exposure to global health courses, emphasizing both pre-medical and clinical phases. Challenges in adjusting course difficulty and recruiting faculty were identified, along with a preference for interactive teaching methods and offline discussions. The curriculum promoted reflection on medicine’s essence, expanded career perspectives, and emphasized competencies like altruism, communication skills, and crisis management in the evolving global health landscape.
Conclusion
This study showed that a comprehensive approach is possible from the perspective of learners and educators by identifying strengths, weaknesses, and the value of the curriculum’s goals, plans, implementations, and results through the CIPP model. For optimal curriculum design, a sequential approach from basic to advanced courses is essential, promoting hands-on global health experiences for students.
2.Is it feasible and effective to provide faculty development programs online for clinical teachers?
Ji Hyun IM ; Ju Whi KIM ; Wan Beom PARK ; Ilkyu HAN ; Seung Hee LEE ; Jwa Seop SHIN ; Hyun Bae YOON
Korean Journal of Medical Education 2021;33(2):139-145
Purpose:
Seoul National University College of Medicine operates a faculty development program for clinical teachers at multiple affiliated teaching hospitals. In 2020, the program was moved online due to coronavirus disease 2019. The purpose of this study was to determine whether it is feasible and effective to provide faculty development programs online in terms of clinical teachers’ participation and satisfaction in comparison with offline programs.
Methods:
Clinical teachers participated in the clinical teaching methods programs offline in 2019 and online in 2020. We analyzed participation rate and satisfaction level. All surveys items were rated on a 5-point Likert scale. We also interviewed instructors about the advantages and drawbacks of the online program.
Results:
The participation rate of the online program (89.5%) was significantly higher than that of the offline program (67.8%). The overall satisfaction level for the online program (4.37) was similar to that for the offline program (4.50).
Conclusion
Faculty development programs online are feasible and effective in medical education. We need to design training content that fits online programs, consider various online training methods to reinforce the strengths of online programs, and support participants to make good use of these programs.
3.Is it feasible and effective to provide faculty development programs online for clinical teachers?
Ji Hyun IM ; Ju Whi KIM ; Wan Beom PARK ; Ilkyu HAN ; Seung Hee LEE ; Jwa Seop SHIN ; Hyun Bae YOON
Korean Journal of Medical Education 2021;33(2):139-145
Purpose:
Seoul National University College of Medicine operates a faculty development program for clinical teachers at multiple affiliated teaching hospitals. In 2020, the program was moved online due to coronavirus disease 2019. The purpose of this study was to determine whether it is feasible and effective to provide faculty development programs online in terms of clinical teachers’ participation and satisfaction in comparison with offline programs.
Methods:
Clinical teachers participated in the clinical teaching methods programs offline in 2019 and online in 2020. We analyzed participation rate and satisfaction level. All surveys items were rated on a 5-point Likert scale. We also interviewed instructors about the advantages and drawbacks of the online program.
Results:
The participation rate of the online program (89.5%) was significantly higher than that of the offline program (67.8%). The overall satisfaction level for the online program (4.37) was similar to that for the offline program (4.50).
Conclusion
Faculty development programs online are feasible and effective in medical education. We need to design training content that fits online programs, consider various online training methods to reinforce the strengths of online programs, and support participants to make good use of these programs.
4.Investigating the effects of interprofessional communication education for medical students
Seung Jae KIM ; Oh Deog KWON ; Kyae Hyung KIM ; Ji Eun LEE ; Seung Hee LEE ; Jwa Seop SHIN ; Sang Min PARK
Korean Journal of Medical Education 2019;31(2):135-145
PURPOSE: Interprofessional communication skills are an essential competency for medical students training to be physicians. Nevertheless, interprofessional education (IPE) is relatively rare in Korean medical schools compared with those overseas. We attempted to evaluate the effectiveness of the first IPE program in our school. METHODS: In the first semester of the school year 2018, third-grade medical students (N=149) at the Seoul National University College of Medicine participated in ‘communication between healthcare professionals in the clinical field’ training, which consisted of small group discussions and role-play. To evaluate the effectiveness of this training, we conducted pre- and post-training questionnaire surveys. Comparing paired t-tests, we evaluated the students' competency in interpersonal communication and their attitude towards the importance of IPE before and after the training. The Global Interpersonal Communication Competence Scale (GICC-15) was used to evaluate competency in interpersonal communication. RESULTS: Out of 149 students, 144 completed the pre- and post-training questionnaires. The total GICC-15 scores before and after training were 55.60±6.94 (mean±standard deviation) and 58.89±7.34, respectively (p=0.000). All subcategory scores of GICC-15 after training were higher after training and were statistically significant (p<0.05), except for two subcategories. The importance of IPE score also improved after training but was not significant (p=0.159). The appropriateness of content and training method scores were 3.99±0.92 and 3.94±1.00, respectively. CONCLUSION: From the results, our school's IPE program demonstrated a positive overall educational effect. Deployment of systematic and varied IPE courses is expected in the future, with more longitudinal evaluation of educational effect.
Delivery of Health Care
;
Education
;
Humans
;
Interprofessional Relations
;
Mental Competency
;
Methods
;
Role Playing
;
Schools, Medical
;
Seoul
;
Students, Medical
5.Applying a mixed methods design for needs assessment of an international fellowship training program for Mongolian health professions
Nomin AMGALAN ; Jwa Seop SHIN ; Seung Hee LEE ; Oyungoo BADAMDORJ ; Hyun Bae YOON
Korean Journal of Medical Education 2019;31(3):227-237
PURPOSE: Continuing professional development is essential for improving health care services, especially in developing countries. Most of the training programs in Mongolia were not based on a targeted needs assessment. Therefore, we aimed to apply a mixed methods design to assess the training needs of Mongolian health professions. METHODS: We conducted a needs assessment using a convergent parallel mixed methods design in two steps. The survey and interview questions were developed to identify priority areas, targeted trainees, and effective training methods. A survey on 60 respondents, 15 individual interviews, and a focus group interview with 14 participants were conducted in the first step. In the second step, 12 representatives of key stakeholders were invited to a second focus group interview. RESULTS: Current health policy areas, areas related to future national plans, and areas not currently receiving governmental or international support were suggested as the main priorities. The stakeholder suggested that trainees should be selected based on their professional experience and language level, as well as each hospital’s needs. Building teams including various professions, such as nurses, technicians, and biomedical engineers, was recommended as a way to exchange ideas with each other and to build teamwork for future collaboration. CONCLUSION: Medical training needs are dynamic and complex; therefore, a deep understanding of the context and setting is necessary. In this study, we assessed the targeted training needs of Mongolian health professions through a mixed methods design, which could be an effective way to conduct needs assessments for training programs.
Cooperative Behavior
;
Delivery of Health Care
;
Developing Countries
;
Education
;
Fellowships and Scholarships
;
Focus Groups
;
Health Occupations
;
Health Policy
;
Methods
;
Mongolia
;
Needs Assessment
;
Surveys and Questionnaires
6.The Effect of the Dr. LEE Jong-wook—Seoul Project on Medical Student Academic Performance in Laos
Jungho KIM ; Taejong KIM ; Jwa Seop SHIN
Korean Medical Education Review 2019;21(1):31-40
The Dr. LEE Jong-wook—Seoul Project (DLSP) in the Lao People'0s Democratic Republic (PDR) is a long-term development cooperation initiative aimed at upgrading the medical education capacity at the University of Health Sciences (UHS) in the Lao PDR. Under the project, eight faculty members from UHS were trained at the Seoul National University College of Medicine for a 12-month period during 2010–2011. Using a training-of-trainers model, we estimated the effect of DLSP on the learning outcomes of students, which was measured using the standard test scores of the students. The questionnaire developed by the Medical Education Assessment Consortium in Korea was given to the students and both the percent-correct and standardized scores were examined. The evaluation strategy was to compare the learning outcomes of the students taught by the trainees with those that were not and to compare the medical topics taught by the trainees with other topics. It was found that the first group of trainees in the DLSP was associated with an increase of 1.5 in the percent-correct test scores for basic medicine. While the interpretation requires caution, it is consistent with the view that a training program for faculty members could be effective in improving the teaching capacity of medical schools in developing countries.
Developing Countries
;
Education
;
Education, Medical
;
Educational Measurement
;
Humans
;
Korea
;
Laos
;
Learning
;
Schools, Medical
;
Seoul
;
Students, Medical
7.Evaluation of Medical Humanities Course in College of Medicine Using the Context, Input, Process, and Product Evaluation Model
So Young LEE ; Seung Hee LEE ; Jwa Seop SHIN
Journal of Korean Medical Science 2019;34(22):e163-
BACKGROUND: Seoul National University College of Medicine has provided a new educational curriculum on basis of the competency-based curriculum since 2016. The new curriculum included the medical humanities course (MHC) to potentiate humanities of medical students. The present study applied the context, input, process and product (CIPP) evaluation model to the MHC in order to confirm the feasibility of the CIPP model and to improve the MHC by questionnaire survey and analysis of teaching materials. METHODS: This study analyzed the MHC provided to the freshmen in 2016 and to the freshmen and sophomores in 2017 by the CIPP model. Firstly, evaluation criteria and indicators were developed according to the CIPP classification. The materials collected from the course were analyzed by quantitative and qualitative analysis according to the evaluation criteria. In the quantitative analysis, an independent sample t-test was performed to verify the difference in the responses between the students (n = 522) and the professors (n = 22). In addition, content analysis was conducted for qualitative evaluation. RESULTS: There were significant differences in perceptions of MHC between students and professors about the results of almost all objective survey questions through the t-test, such as score 3.64 in students and 4.48 in professors in response to the item of ‘provision of appropriate feedback.’ As a result of the content analysis, 7 categories and 20 subcategories were derived. There were the most responses to various instructional methods (students, 20%; professors, 21.5%). CONCLUSION: The CIPP evaluation model was acceptable for the MHC analysis. The first task is to raise students' awareness of the MHC in order to improve the MHC quality.
Classification
;
Curriculum
;
Evaluation Studies as Topic
;
Humanities
;
Humans
;
Seoul
;
Students, Medical
;
Teaching Materials
8.Investigating the effects of interprofessional communication education for medical students
Seung Jae KIM ; Oh Deog KWON ; Kyae Hyung KIM ; Ji Eun LEE ; Seung Hee LEE ; Jwa Seop SHIN ; Sang Min PARK
Korean Journal of Medical Education 2019;31(2):135-145
PURPOSE:
Interprofessional communication skills are an essential competency for medical students training to be physicians. Nevertheless, interprofessional education (IPE) is relatively rare in Korean medical schools compared with those overseas. We attempted to evaluate the effectiveness of the first IPE program in our school.
METHODS:
In the first semester of the school year 2018, third-grade medical students (N=149) at the Seoul National University College of Medicine participated in ‘communication between healthcare professionals in the clinical field’ training, which consisted of small group discussions and role-play. To evaluate the effectiveness of this training, we conducted pre- and post-training questionnaire surveys. Comparing paired t-tests, we evaluated the students' competency in interpersonal communication and their attitude towards the importance of IPE before and after the training. The Global Interpersonal Communication Competence Scale (GICC-15) was used to evaluate competency in interpersonal communication.
RESULTS:
Out of 149 students, 144 completed the pre- and post-training questionnaires. The total GICC-15 scores before and after training were 55.60±6.94 (mean±standard deviation) and 58.89±7.34, respectively (p=0.000). All subcategory scores of GICC-15 after training were higher after training and were statistically significant (p<0.05), except for two subcategories. The importance of IPE score also improved after training but was not significant (p=0.159). The appropriateness of content and training method scores were 3.99±0.92 and 3.94±1.00, respectively.
CONCLUSION
From the results, our school's IPE program demonstrated a positive overall educational effect. Deployment of systematic and varied IPE courses is expected in the future, with more longitudinal evaluation of educational effect.
9.Applying a mixed methods design for needs assessment of an international fellowship training program for Mongolian health professions
Nomin AMGALAN ; Jwa Seop SHIN ; Seung Hee LEE ; Oyungoo BADAMDORJ ; Hyun Bae YOON
Korean Journal of Medical Education 2019;31(3):227-237
PURPOSE:
Continuing professional development is essential for improving health care services, especially in developing countries. Most of the training programs in Mongolia were not based on a targeted needs assessment. Therefore, we aimed to apply a mixed methods design to assess the training needs of Mongolian health professions.
METHODS:
We conducted a needs assessment using a convergent parallel mixed methods design in two steps. The survey and interview questions were developed to identify priority areas, targeted trainees, and effective training methods. A survey on 60 respondents, 15 individual interviews, and a focus group interview with 14 participants were conducted in the first step. In the second step, 12 representatives of key stakeholders were invited to a second focus group interview.
RESULTS:
Current health policy areas, areas related to future national plans, and areas not currently receiving governmental or international support were suggested as the main priorities. The stakeholder suggested that trainees should be selected based on their professional experience and language level, as well as each hospital’s needs. Building teams including various professions, such as nurses, technicians, and biomedical engineers, was recommended as a way to exchange ideas with each other and to build teamwork for future collaboration.
CONCLUSION
Medical training needs are dynamic and complex; therefore, a deep understanding of the context and setting is necessary. In this study, we assessed the targeted training needs of Mongolian health professions through a mixed methods design, which could be an effective way to conduct needs assessments for training programs.
10.How to execute Context, Input, Process, and Product evaluation model in medical health education
So young LEE ; Jwa-Seop SHIN ; Seung-Hee LEE
Journal of Educational Evaluation for Health Professions 2019;16():40-
Improvements to education are necessary in order to keep up with the education requirements of today. The Context, Input, Process, and Product (CIPP) evaluation model was created for the decision-making towards education improvement, so this model is appropriate in this regard. However, application of this model in the actual context of medical health education is considered difficult in the education environment. Thus, in this study, literature survey of previous studies was investigated to examine the execution procedure of how the CIPP model can be actually applied. For the execution procedure utilizing the CIPP model, the criteria and indicators were determined from analysis results and material was collected after setting the material collection method. Afterwards, the collected material was analyzed for each CIPP element, and finally, the relationship of each CIPP element was analyzed for the final improvement decision-making. In this study, these steps were followed and the methods employed in previous studies were organized. Particularly, the process of determining the criteria and indicators was important and required a significant effort. Literature survey was carried out to analyze the most widely used criteria through content analysis and obtained a total of 12 criteria. Additional emphasis is necessary in the importance of the criteria selection for the actual application of the CIPP model. Also, a diverse range of information can be obtained through qualitative as well as quantitative methods. Above all, since the CIPP evaluation model execution result becomes the basis for the execution of further improved evaluations, the first attempt of performing without hesitation is essential.

Result Analysis
Print
Save
E-mail