1.A new performance evaluation indicator for the LEE Jong-wook Fellowship Program of Korea Foundation for International Healthcare to better assess its long-term educational impacts: a Delphi study
Journal of Educational Evaluation for Health Professions 2024;21(1):27-
Purpose:
The Dr. LEE Jong-wook Fellowship Program, established by the Korea Foundation for International Healthcare (KOFIH), aims to strengthen healthcare capacity in partner countries. The aim of the study was to develop new performance evaluation indicators for the program to better assess long-term educational impact across various courses and professional roles.
Methods:
A 3-stage process was employed. First, a literature review of established evaluation models (Kirkpatrick’s 4 levels, context/input/process/product evaluation model, Organization for Economic Cooperation and Development Assistance Committee criteria) was conducted to devise evaluation criteria. Second, these criteria were validated via a 2-round Delphi survey with 18 experts in training projects from May 2021 to June 2021. Third, the relative importance of the evaluation criteria was determined using the analytic hierarchy process (AHP), calculating weights and ensuring consistency through the consistency index and consistency ratio (CR), with CR values below 0.1 indicating acceptable consistency.
Results:
The literature review led to a combined evaluation model, resulting in 4 evaluation areas, 20 items, and 92 indicators. The Delphi surveys confirmed the validity of these indicators, with content validity ratio values exceeding 0.444. The AHP analysis assigned weights to each indicator, and CR values below 0.1 indicated consistency. The final set of evaluation indicators was confirmed through a workshop with KOFIH and adopted as the new evaluation tool.
Conclusion
The developed evaluation framework provides a comprehensive tool for assessing the long-term outcomes of the Dr. LEE Jong-wook Fellowship Program. It enhances evaluation capabilities and supports improvements in the training program’s effectiveness and international healthcare collaboration.
2.A new performance evaluation indicator for the LEE Jong-wook Fellowship Program of Korea Foundation for International Healthcare to better assess its long-term educational impacts: a Delphi study
Journal of Educational Evaluation for Health Professions 2024;21(1):27-
Purpose:
The Dr. LEE Jong-wook Fellowship Program, established by the Korea Foundation for International Healthcare (KOFIH), aims to strengthen healthcare capacity in partner countries. The aim of the study was to develop new performance evaluation indicators for the program to better assess long-term educational impact across various courses and professional roles.
Methods:
A 3-stage process was employed. First, a literature review of established evaluation models (Kirkpatrick’s 4 levels, context/input/process/product evaluation model, Organization for Economic Cooperation and Development Assistance Committee criteria) was conducted to devise evaluation criteria. Second, these criteria were validated via a 2-round Delphi survey with 18 experts in training projects from May 2021 to June 2021. Third, the relative importance of the evaluation criteria was determined using the analytic hierarchy process (AHP), calculating weights and ensuring consistency through the consistency index and consistency ratio (CR), with CR values below 0.1 indicating acceptable consistency.
Results:
The literature review led to a combined evaluation model, resulting in 4 evaluation areas, 20 items, and 92 indicators. The Delphi surveys confirmed the validity of these indicators, with content validity ratio values exceeding 0.444. The AHP analysis assigned weights to each indicator, and CR values below 0.1 indicated consistency. The final set of evaluation indicators was confirmed through a workshop with KOFIH and adopted as the new evaluation tool.
Conclusion
The developed evaluation framework provides a comprehensive tool for assessing the long-term outcomes of the Dr. LEE Jong-wook Fellowship Program. It enhances evaluation capabilities and supports improvements in the training program’s effectiveness and international healthcare collaboration.
3.A new performance evaluation indicator for the LEE Jong-wook Fellowship Program of Korea Foundation for International Healthcare to better assess its long-term educational impacts: a Delphi study
Journal of Educational Evaluation for Health Professions 2024;21(1):27-
Purpose:
The Dr. LEE Jong-wook Fellowship Program, established by the Korea Foundation for International Healthcare (KOFIH), aims to strengthen healthcare capacity in partner countries. The aim of the study was to develop new performance evaluation indicators for the program to better assess long-term educational impact across various courses and professional roles.
Methods:
A 3-stage process was employed. First, a literature review of established evaluation models (Kirkpatrick’s 4 levels, context/input/process/product evaluation model, Organization for Economic Cooperation and Development Assistance Committee criteria) was conducted to devise evaluation criteria. Second, these criteria were validated via a 2-round Delphi survey with 18 experts in training projects from May 2021 to June 2021. Third, the relative importance of the evaluation criteria was determined using the analytic hierarchy process (AHP), calculating weights and ensuring consistency through the consistency index and consistency ratio (CR), with CR values below 0.1 indicating acceptable consistency.
Results:
The literature review led to a combined evaluation model, resulting in 4 evaluation areas, 20 items, and 92 indicators. The Delphi surveys confirmed the validity of these indicators, with content validity ratio values exceeding 0.444. The AHP analysis assigned weights to each indicator, and CR values below 0.1 indicated consistency. The final set of evaluation indicators was confirmed through a workshop with KOFIH and adopted as the new evaluation tool.
Conclusion
The developed evaluation framework provides a comprehensive tool for assessing the long-term outcomes of the Dr. LEE Jong-wook Fellowship Program. It enhances evaluation capabilities and supports improvements in the training program’s effectiveness and international healthcare collaboration.
4.Adapting an Integrated Program Evaluation for Promoting Competency‐Based Medical Education
Hyunjung JU ; Minkyung OH ; Jong-Tae LEE ; Bo Young YOON
Korean Medical Education Review 2021;23(1):56-67
Educational program evaluation can improve the quality of the curriculum, instructional methods, and resources and provide useful data for making educational decisions and policies. Developing and implementing a program evaluation system is essential in competency-based medical education. The purpose of this study was to explore and establish an educational program evaluation system adapting an integrated program evaluation model to promote competency-based medical education. First, an Educational Evaluation Committee was organized, consisting of faculty, staff members, and students. The committee established an integrated program evaluation model, combining Stufflebeam’s Context, Input, Process, and Product (CIPP) model of a process-oriented approach and Kirkpatrick’s four-level model of an outcome-oriented approach. Kirkpatrick’s model was applied to the product evaluation of the CIPP model. The committee then developed evaluation criteria, indicators, and data collection methods according to the components of the CIPP model and the four levels (reaction, learning, behavior, and results) of Kirkpatrick’s model, and collected and analyzed data. Finally, the committee reported the results of evaluation to a Medical Education Quality Improvement Committee, and the results were used to improve the curriculum and student selection. To enhance the quality of education, identifying educational deficiencies and developing various elements of education in a balanced way through educational evaluation will be needed. Furthermore, it will be necessary to listen to opinions of various stakeholders, work with all members involved in education, and communicate with decision-makers in the process of educational evaluation.
5.Establishment of Cohorts to Evaluate the Performance of Students and Graduates at a Medical School
Minkyung OH ; Hyunjung JU ; Bo Young YOON ; Jong-Tae LEE
Korean Medical Education Review 2022;24(3):250-260
Evaluating the effectiveness of educational programs involves measuring learning processes as well as outcomes.It is essential to study cohorts of students and graduates to evaluate the long-term effects of educational programs with data generated both during education and after graduation. The purpose of this study was to establish cohorts of students and graduates to evaluate their performance, thereby providing a basis for evaluating the social accountability of medical education. In this study, student and graduate cohorts were built for both students currently enrolled and graduates at Inje University College of Medicine (IUCM). A model involving the process of cohort establishment and an evaluation indicator framework was developed. In the process of cohort establishment, the following steps were conducted: defining the goals and objectives of the student and graduate cohorts, organizing a cohort committee, developing regulations, registering cohorts, acquiring consent, and building a database. A framework of evaluation indicators according to the graduate roles of IUCM was developed by adapting Kirkpatrick’s evaluation model. Next, items to be collected in student and graduate cohorts were selected, and the current status of existing data was analyzed. Moreover, a preliminary analysis was conducted, including analyses of the evaluation indicators and graduates’ performance. This study suggests that it is necessary to include additional evaluation indicators considering students’ learning environment and well-being in student cohorts and to develop strategies or methods for graduates to continue participating in data collection for a long-term study.
6.The Effect of Environmental Tobacco Smoke Exposure and Glutathione S-Transferase Polymorphism on Childhood Behavioral Development during Mid-Pregnancy and Early Childhood.
Jooyoun SONG ; Hye Ah LEE ; Minkyung KIM ; Hwayoung LEE ; Eun Ae PARK ; Hyesook PARK ; Kyu Wol YUN ; Eui Jung KIM
Journal of Korean Neuropsychiatric Association 2011;50(6):465-475
OBJECTIVES: The author investigated the relationship between the environmental tobacco smoke exposure during mid-pregnancy and early childhood and neurobehavioral outcomes of preschool children and if there is any effect of the genetic polymorphism of glutathione S-transferase (GST) M1 and T1 on this relationship. METHODS: The participants were the pregnant women (week 24-28) who visited the obstetrics and gynecology department (between 2001 and 2004). They had been evaluated for their sociodemographic data including direct and environmental tobacco smoke exposure history and the urine specimen had been sampled for the measurement of cotinine. The offsprings' urine specimen and blood sampling had been done and the socioeconomic data including the environmental tobacco smoke exposure history was evaluated at age 3. The cotinine level of urine specimen was measured and GST polymorphism was analyzed. The offsprings completed Korean-Childhood Behavioral Check List (K-CBCL) at age 4-5. RESULTS: The environmental tobacco smoke exposure during mid-pregnancy based on urine cotinine level has a significant association with increased total score and externalizing problem score of K-CBCL (p<0.05). The environmental tobacco smoke exposure based on urine cotinine level at age 3 is associated increased total score, externalizing problem score and internalizing problem score of K-CBCL with no statistical significance. The environmental tobacco smoke exposure after controlling for tobacco smoke exposure during pregnancy, however, is significantly associated with the increased externalizing problem scores (p=0.04). The environmental tobacco smoke exposure is associated with increased total score, externalizing problem score and internalizing problem score of K-CBCL with GSTM1 null type or GSTT1 null type at age 3 although there was no statistical significance. CONCLUSION: The environmental tobacco smoking exposure during pregnancy and at early childhood is associated with childhood behavioral problems. The clinical implication of this study is that it is important to avoid the environmental tobacco smoke exposure during pregnancy and early childhood and to monitor the possible emergence of behavioral problems of children.
Child
;
Child, Preschool
;
Cotinine
;
Female
;
Glutathione
;
Glutathione Transferase
;
Gynecology
;
Humans
;
Obstetrics
;
Organothiophosphorus Compounds
;
Polymorphism, Genetic
;
Pregnancy
;
Pregnant Women
;
Smoke
;
Smoking
;
Tobacco
7.Efficacy of Surfactant-TA, Calfactant and Poractant Alfa for Preterm Infants with Respiratory Distress Syndrome: A Retrospective Study.
Ga Won JEON ; Minkyung OH ; Jong Beom SIN
Yonsei Medical Journal 2015;56(2):433-439
PURPOSE: To compare the efficacy of the new drug calfactant with the commonly used drugs surfactant-TA and poractant alfa. MATERIALS AND METHODS: A total of 332 preterm infants at 24-31 weeks' gestation with respiratory distress syndrome (RDS) were enrolled and allocated to three groups according to the surfactant instilled; Group 1 (n=146, surfactant-TA), Group 2 (n=96, calfactant), and Group 3 (n=90, poractant alfa). The diagnosis of RDS and the decision to replace the pulmonary surfactant were left to the attending physician and based on patient severity determined by chest radiography and blood gas analysis. Data were collected and reviewed retrospectively using patient medical records. RESULTS: Demographic factors including gestational age, birth weight, Apgar score, clinical risk index for babies II score, and maternal status before delivery were not different between the study groups. Instances of surfactant redosing and pulmonary air leaks, as well as duration of mechanical ventilation, were also not different. Rates of patent ductus arteriosus, intraventricular hemorrhage (> or =grade III), periventricular leukomalacia, high stage retinopathy of prematurity, necrotizing enterocolitis (> or =stage II), and mortality were also similar, as was duration of hospital stay. Cases of pulmonary hemorrhage and moderate to severe bronchopulmonary dysplasia were increased in Group 3. CONCLUSION: Calfactant is equally as effective as surfactant-TA and poractant alfa. This was the first study comparing the efficacy of surfactant-TA, calfactant, and poractant alfa in a large number of preterm infants in Korea. Further randomized prospective studies on these surfactants are needed.
Biological Products/administration & dosage/*therapeutic use
;
Birth Weight
;
Bronchopulmonary Dysplasia/drug therapy
;
Female
;
Gestational Age
;
Humans
;
Infant, Newborn
;
Infant, Premature
;
Male
;
Phospholipids/administration & dosage/*therapeutic use
;
Pulmonary Surfactants/administration & dosage/*therapeutic use
;
Republic of Korea
;
Respiration, Artificial
;
Respiratory Distress Syndrome, Newborn/*drug therapy
;
Retrospective Studies
;
Risk
;
Treatment Outcome
;
Ventilator Weaning
8.Efficacy of Surfactant-TA, Calfactant and Poractant Alfa for Preterm Infants with Respiratory Distress Syndrome: A Retrospective Study.
Ga Won JEON ; Minkyung OH ; Jong Beom SIN
Yonsei Medical Journal 2015;56(2):433-439
PURPOSE: To compare the efficacy of the new drug calfactant with the commonly used drugs surfactant-TA and poractant alfa. MATERIALS AND METHODS: A total of 332 preterm infants at 24-31 weeks' gestation with respiratory distress syndrome (RDS) were enrolled and allocated to three groups according to the surfactant instilled; Group 1 (n=146, surfactant-TA), Group 2 (n=96, calfactant), and Group 3 (n=90, poractant alfa). The diagnosis of RDS and the decision to replace the pulmonary surfactant were left to the attending physician and based on patient severity determined by chest radiography and blood gas analysis. Data were collected and reviewed retrospectively using patient medical records. RESULTS: Demographic factors including gestational age, birth weight, Apgar score, clinical risk index for babies II score, and maternal status before delivery were not different between the study groups. Instances of surfactant redosing and pulmonary air leaks, as well as duration of mechanical ventilation, were also not different. Rates of patent ductus arteriosus, intraventricular hemorrhage (> or =grade III), periventricular leukomalacia, high stage retinopathy of prematurity, necrotizing enterocolitis (> or =stage II), and mortality were also similar, as was duration of hospital stay. Cases of pulmonary hemorrhage and moderate to severe bronchopulmonary dysplasia were increased in Group 3. CONCLUSION: Calfactant is equally as effective as surfactant-TA and poractant alfa. This was the first study comparing the efficacy of surfactant-TA, calfactant, and poractant alfa in a large number of preterm infants in Korea. Further randomized prospective studies on these surfactants are needed.
Biological Products/administration & dosage/*therapeutic use
;
Birth Weight
;
Bronchopulmonary Dysplasia/drug therapy
;
Female
;
Gestational Age
;
Humans
;
Infant, Newborn
;
Infant, Premature
;
Male
;
Phospholipids/administration & dosage/*therapeutic use
;
Pulmonary Surfactants/administration & dosage/*therapeutic use
;
Republic of Korea
;
Respiration, Artificial
;
Respiratory Distress Syndrome, Newborn/*drug therapy
;
Retrospective Studies
;
Risk
;
Treatment Outcome
;
Ventilator Weaning
9.Clinical Outcome after Breast Conserving Surgery and Radiation Therapy for Early Breast Cancer.
Heunglae CHO ; Cheoljin KIM ; Sungkwang PARK ; Minkyung OH ; Jinyong LEE ; Kijung AHN
The Journal of the Korean Society for Therapeutic Radiology and Oncology 2008;26(4):204-212
PURPOSE: This study was performed to evaluate the disease-free survival and risk factors of recurrence in early breast cancer patients who have undergone breast conserving surgery and radiation therapy. MATERIALS AND METHODS: From March 1997 to December 2002, 77 breast cancer patients who underwent breast conserving surgery and radiation therapy were reviewed retrospectively. The median follow-up time was 58.4 months (range 43.8~129.4 months) and the mean subject age was 41 years. The frequency distribution of the different T stages, based on the tumor characteristics was 38 (49.3%) for T1, 28 (36.3%) for T2, 3 for T3, 7 for Tis and 1 for an unidentified sized tumor. In addition, 52 patients (67.5%) did not have axillary lymph metastasis, whereas 14 patients (18.1%) had 1~3 lymph node metastases and 3 (0.03%) had more than 4 lymph node metastases. The resection margin was negative in 59 patients, close (< or =2 mm) in 15, and positive in 4. All patients received radiation therapy at the intact breast using tangential fields with a subsequent electron beam boost to the tumor bed at a total dose ranging from 59.4 Gy to 66.4 Gy. Patients with more than four positive axillary lymph nodes received radiation therapy (41.4~60.4 Gy) at the axillary and supraclavicular area. Chemotherapy was administered in 59 patients and tamoxifen or fareston was administered in 29 patients. RESULTS: The 5 year overall survival and disease-free survival rates were 98.08% and 93.49%, respectively. Of the 77 patients, a total of 4 relapses (5.2%), including 1 isolated supraclavicular relapse, 1 supraclavicular relapse with synchronous multiple distant relapses, and 2 distant relapses were observed. No cases of local breast relapses were observed. Lymph node metastasis or number of metastatic lymph nodes was not found to be statistically related with a relapse (p=0.3289) nor disease-free survival (p=0.1430). Patients with positive margins had a significantly shorter disease-free survival period (p<0.0001) and higher relapse rates (p=0.0507). However, patients with close margins were at equal risk of relapse and disease-free survival as with negative margins (p=1.000). Patients younger than 40 years of age had higher relapse rates (9.3% vs. 0%) and lower disease-free survival periods, but the difference was not statistically significant (p=0.1255). The relapse rates for patients with tumors was 14% for tumor stage T2, compared to 0% for tumor stage T1 tumors (p=0.0284). A univariate analysis found that disease-free survival and relapse rates, T stage, positive resection margin and mutation of p53 were significant factors for clinical outcome. CONCLUSION: The results of this study have shown that breast conservation surgery and radiation therapy in early breast cancer patients has proven to be a safe treatment modality with a low relapse rate and high disease-free survival rate. The patients with a positive margin, T2 stage, and mutation of p53 are associated with statistically higher relapse rates and lower disease-free survival.
Risk Factors
;
Neoplasm Metastasis
;
Breast Neoplasms
10.Survey of physicians' views on the clinical implementation of pharmacogenomics-based personalized therapy
Woo-Young KIM ; Ho-Sook KIM ; Minkyung OH ; Jae-Gook SHIN
Translational and Clinical Pharmacology 2020;28(1):34-42
Despite quantitative increases and qualitative advances in pharmacogenomics (PGx) research, the clinical implementation of PGx-based personalized therapy has still been limited. The objective of this study was to assess physicians' self-reported knowledge of PGx-based personalized therapy, and to explore the most problematic and highest priority barriers preventing physicians from applying PGx into clinical practice under the Korean healthcare system. A 36-question survey was distributed to 53 physicians with various specialties in Korea. In the physicians' self-perceived knowledge, twenty-eight physicians (53%) reported a lack sufficient knowledge about PGx. The perceived largest barrier to clinical implementation of PGx was the high cost of PGx testing, followed by a lack of PGx education for healthcare providers or lack of clinical PGx experts. Physicians without clinical PGx experience or with indirect experience reported that the largest barrier to clinical implementation of PGx was the high cost of PGx testing, while physicians with clinical PGx experience pointed out that a lack of patients' education was the major concern, followed by a lack of PGx education for healthcare providers or lack of clinical PGx experts. The highest priority problem was reported to be a lack of actionable guidelines for drug selection and dosing using PGx. In conclusion, we should increase and expand extensive educational programs for healthcare providers and patients, and to develop and establish a clinical decision support systems for PGx-based personalized therapy in Korea.