Evaluation of educational interventions is often focused on immediate and/or short-term metrics associated with knowledge and/or skills acquisition. We developed an educational intervention to support international medical graduates working in rural Victoria. We wanted an evaluation strategy that included participants' reactions and considered transfer of learning to the workplace and retention of learning. However, with participants in distributed locations and limited program resources, this was likely to prove challenging. Elsewhere, we have reported the outcomes of this evaluation. In this educational development report, we describe our evaluation strategy as a case study, its underpinning theoretical framework, the strategy, and its benefits and challenges. The strategy sought to address issues of program structure, process, and outcomes. We used a modified version of Kirkpatrick's model as a framework to map our evaluation of participants' experiences, acquisition of knowledge and skills, and their application in the workplace. The predominant benefit was that most of the evaluation instruments allowed for personalization of the program. The baseline instruments provided a broad view of participants' expectations, needs, and current perspective on their role. Immediate evaluation instruments allowed ongoing tailoring of the program to meet learning needs. Intermediate evaluations facilitated insight on the transfer of learning. The principal challenge related to the resource intensive nature of the evaluation strategy. A dedicated program administrator was required to manage data collection. Although resource-intensive, we recommend baseline, immediate, and intermediate data collection points, with multi-source feedback being especially illuminating. We believe our experiences may be valuable to faculty involved in program evaluations.
Administrative Personnel ; Data Collection ; Education, Medical ; Educational Measurement ; Humans ; Learning ; Program Evaluation ; Retention (Psychology) ; Students, Medical ; Transfer (Psychology) ; Victoria

Concern has been raised about inadequate pharmacology teaching in medical schools and the high incidence of prescribing errors by doctors in training. Modifications in pharmacology teaching have been carried out in many countries. The present study was carried out using a semi-structured questionnaire to obtain students' perceptions of their knowledge, attitudes, and skills with regard to different subject areas related to rational prescribing at the end of two-year activity-based pharmacology practical learning sessions in a private medical school in Nepal. The effectiveness of the sessions and strengths and suggestions to further improve the sessions were also obtained. The median total knowledge, attitude, skills and overall scores were calculated and compared among different subgroups of respondents. The median effectiveness score was also calculated. Eighty of the 100 students participated; 37 were male and 43 female. The median knowledge, attitude, and skills scores were 24, 39, and 23, respectively (maximum scores being 27, 45, and 36). The median total score was 86 (maximum score being 108). The effectiveness score for most subject areas was 3 (maximum 4). The strengths were the activity-based nature of the session, use of videos and role-plays, and repeated practice. Students wanted more sessions and practice in certain areas. They also wanted more resources and an internet connection in the practical room. The skills scores were relatively low. The immediate impact of the sessions was positive. Studies may be needed to assess the long term impact. Similar programs should be considered in other medical schools in Nepal and other developing countries.
Surveys and Questionnaires ; Developing Countries ; Female ; Humans ; Incidence ; Internet ; Learning ; Male ; Nepal ; Schools, Medical

Pharmaceutical promotion is an integral part of modern medical practice. Surveys show that medical students have a positive attitude towards promotion. Pharmaceutical promotion is not adequately taught in medical schools. A module based on the manual produced by Health Action International was conducted for second year medical students at KIST Medical College, Lalitpur, Nepal. Student feedback on various aspects of the module was obtained using a semi-structured questionnaire. Eighty-six of the 100 students (86%) provided feedback about the module. Forty-five (52.3%) were female and 39 (45.3%) were male. Participant feedback about the module was positive. Small group work and role plays were appreciated, and the ratings of the module and the manual were satisfactory. Respondents felt pharmaceutical promotion will play an important role in their future practice and that the module prepared them to respond appropriately to promotion and select and use medicines properly. The module further developed on issues covered during pharmacology practical and majority felt the module was of relevance to Nepal. Students appreciated the module though there were suggestions for improvement. The module should be considered during the years of clinical training (third and fourth years) and internship and in other medical schools.
Surveys and Questionnaires ; Female ; Humans ; Internship and Residency ; Learning ; Male ; Marketing ; Nepal ; Problem-Based Learning ; Schools, Medical ; Students, Medical

No abstract available.
Lectures

A team-based Learning (TBL) tutor training workshop on research and publication ethics was offered to 8 faculty members and 3 staff at Hallym University in 2009. To investigate the effect of the workshop and any attitude changes, a questionnaire survey was performed after the 8-hr course. Questions in four categories-general course content, change in attitudes toward research and publication ethics, the TBL format, and an open-ended question about the course--were included. Participants responded positively to all items on general course content. There was a positive change in attitude on research and publication ethics. Participants also responded positively to six items on team-based learning. The overall positive response to the workshop on research and publication ethics suggested the effectiveness of this kind of TBL tutor training course for university faculty and staff.
Ethics, Research ; Learning ; Publications ; Surveys and Questionnaires

The author developed a freely available open source internet-based testing program for medical examination. PHP and Java script were used as the programming language and postgreSQL as the database management system on an Apache web server and Linux operating system. The system approach was that a super user inputs the items, each school administrator inputs the examinees' information, and examinees access the system. The examinee's score is displayed immediately after examination with item analysis. The set-up of the system beginning with installation is described. This may help medical professors to easily adopt an internet-based testing system for medical education.
Administrative Personnel ; APACHE ; Database Management Systems ; Education, Medical ; Humans ; Indonesia ; Programming Languages ; Students, Medical

High-fidelity patient simulation (HFPS) has been hypothesized as a modality for assessing competency of knowledge and skill in patient simulation, but uniform methods for HFPS performance assessment (PA) have not yet been completely achieved. Anesthesiology as a field founded the HFPS discipline and also leads in its PA. This project reviews the types, quality, and designated purpose of HFPS PA tools in anesthesiology. We used the systematic review method and systematically reviewed anesthesiology literature referenced in PubMed to assess the quality and reliability of available PA tools in HFPS. Of 412 articles identified, 50 met our inclusion criteria. Seventy seven percent of studies have been published since 2000; more recent studies demonstrated higher quality. Investigators reported a variety of test construction and validation methods. The most commonly reported test construction methods included "modified Delphi Techniques" for item selection, reliability measurement using inter-rater agreement, and intra-class correlations between test items or subtests. Modern test theory, in particular generalizability theory, was used in nine (18%) of studies. Test score validity has been addressed in multiple investigations and shown a significant improvement in reporting accuracy. However the assessment of predicative has been low across the majority of studies. Usability and practicality of testing occasions and tools was only anecdotally reported. To more completely comply with the gold standards for PA design, both shared experience of experts and recognition of test construction standards, including reliability and validity measurements, instrument piloting, rater training, and explicit identification of the purpose and proposed use of the assessment tool, are required.
Anesthesiology ; Humans ; Patient Simulation ; Reproducibility of Results ; Research Personnel

This review aims to introduce the Taiwanese Medical Accreditation System: its history, role and future goals. In 1999, the Ministry of Education, Taiwanese Government commissioned the non-profit National Health Research Institutes (NHRI) to develop a new medical accreditation system. According to that policy, the Taiwan Medical Accreditation Council (TMAC) was established in the same year. The council serves a similar function to that of the Liaison Committee on Medical Education (LCME) of the United States and the Australian Medical Council (AMC). The accreditation process consists of a self-assessment plus a four-day site visit by a team of eight medical educators that are headed by one of the council members of the TMAC. The first cycle of initial visits was completed from 2001 to 2004. Subsequent follow-up visits were arranged according to the results of the survey with smaller-sized teams and shorter periods. There is evidence to suggest that the majority (seven of eleven) of the medical schools in Taiwan have made good progress. TMAC's next step will be to monitor the progress and raise the standard of medical education in individual schools with a homogenous, superior standard of medical education.
Academies and Institutes ; Accreditation ; Education, Medical ; Follow-Up Studies ; Head ; Humans ; Organothiophosphorus Compounds ; Schools, Medical ; Self-Assessment ; Taiwan ; United States

No abstract available.
Accreditation ; Education, Medical ; Korea

PURPOSE: In Pakistan, courses in pharmacy practice, which are an essential component of the PharmD curriculum, were launched with the aim of strengthening pharmacy practice overall and enabling pharmacy students to cope with the challenges involved in meeting real-world healthcare needs. Since very little research has assessed the efficacy of such courses, we aimed to evaluate students' perceptions of pharmacy practice courses and their opinions about whether their current knowledge of the topics covered in pharmacy practice courses is adequate for future practice. METHODS: A cross-sectional study was conducted over two months among the senior pharmacy students of two pharmacy colleges. A content- and face-validated questionnaire was used to collect data, which were then analysed using SPSS version 20. Descriptive analysis and logistic regression were performed. RESULTS: Research in pharmacy practice (30.2%), applied drug information (34.4%), health policy (38.1%), public health and epidemiology (39.5%), pharmacovigilance (45.6%), and pharmacoeconomics (47.9%) were the major courses that were covered to the least extent in the PharmD curriculum. However, hospital pharmacy practice (94.4%), pharmacotherapeutics (88.8%), and community pharmacy practice (82.8%) were covered well. Although 94% of students considered these courses important, only 37.2% considered themselves to be competent in the corresponding topics. Of the participants, 87.9% agreed that the pharmacy courses in the present curriculum should be redesigned. CONCLUSION: Our results showed that the pharmacy practice courses in the current PharmD curriculum do not encompass some important core subjects. A nationwide study is warranted to further establish the necessity for remodelling pharmacy practice courses in Pakistan.
Cross-Sectional Studies ; Curriculum ; Delivery of Health Care ; Economics, Pharmaceutical ; Education, Pharmacy ; Epidemiology ; Health Policy ; Humans ; Logistic Models ; Pakistan* ; Pharmacies ; Pharmacovigilance ; Pharmacy* ; Public Health ; Students, Pharmacy*