We evaluated the effectiveness of text messaging versus email, as a delivery method to enhance knowledge retention of emergency medicine (EM) content in EM residents. We performed a multi-centered, prospective, randomized study consisting of postgraduate year (PGY) 1 to PGY 3 & 4 residents in three United States EM residency programs in 2014. Fifty eight residents were randomized into one delivery group: text message or email. Participants completed a 40 question pre- and post-intervention exam. Primary outcomes were the means of pre- and post-intervention exam score differences. Data were analyzed using descriptive statistics, paired t-test, and multiple linear regressions. No significant difference was found between the primary outcomes of the two groups (P=0.51). PGY 2 status had a significant negative effect (P=0.01) on predicted exam score difference. Neither delivery method enhanced resident knowledge retention. Further research on implementation of mobile technology in residency education is required.
Education ; Electronic Mail* ; Emergencies* ; Emergency Medicine* ; Internship and Residency ; Linear Models ; Methods ; Prospective Studies ; Text Messaging* ; United States*

No abstract available.
Education, Medical*

PURPOSE: The aim of this research was to compare different methods of calibrating multiple choice question (MCQ) and clinical decision making (CDM) components for the Medical Council of Canada's Qualifying Examination Part I (MCCQEI) based on item response theory. METHODS: Our data consisted of test results from 8,213 first time applicants to MCCQEI in spring and fall 2010 and 2011 test administrations. The data set contained several thousand multiple choice items and several hundred CDM cases. Four dichotomous calibrations were run using BILOG-MG 3.0. All 3 mixed item format (dichotomous MCQ responses and polytomous CDM case scores) calibrations were conducted using PARSCALE 4. RESULTS: The 2-PL model had identical numbers of items with chi-square values at or below a Type I error rate of 0.01 (83/3,499 or 0.02). In all 3 polytomous models, whether the MCQs were either anchored or concurrently run with the CDM cases, results suggest very poor fit. All IRT abilities estimated from dichotomous calibration designs correlated very highly with each other. IRT-based pass-fail rates were extremely similar, not only across calibration designs and methods, but also with regard to the actual reported decision to candidates. The largest difference noted in pass rates was 4.78%, which occurred between the mixed format concurrent 2-PL graded response model (pass rate= 80.43%) and the dichotomous anchored 1-PL calibrations (pass rate= 85.21%). CONCLUSION: Simpler calibration designs with dichotomized items should be implemented. The dichotomous calibrations provided better fit of the item response matrix than more complex, polytomous calibrations.
Calibration ; Canada ; Clinical Decision-Making ; Dataset ; Educational Measurement ; Licensure

PURPOSE: The goal of this study was to characterize the difficulty index of the items in the skills test components of the class I and II Korean emergency medical technician licensing examination (KEMTLE), which requires examinees to select items randomly. METHODS: The results of 1,309 class I KEMTLE examinations and 1,801 class II KEMTLE examinations in 2013 were subjected to analysis. Items from the basic and advanced skills test sections of the KEMTLE were compared to determine whether some were significantly more difficult than others. RESULTS: In the class I KEMTLE, all 4 of the items on the basic skills test showed significant variation in difficulty index (P<0.01), as well as 4 of the 5 items on the advanced skills test (P<0.05). In the class II KEMTLE, 4 of the 5 items on the basic skills test showed significantly different difficulty index (P<0.01), as well as all 3 of the advanced skills test items (P<0.01). CONCLUSION: In the skills test components of the class I and II KEMTLE, the procedure in which examinees randomly select questions should be revised to require examinees to respond to a set of fixed items in order to improve the reliability of the national licensing examination.
Emergencies* ; Emergency Medical Technicians* ; Humans ; Licensure*

No abstract available.
Delivery of Health Care* ; Licensure* ; Specialization*

PURPOSE: To determine the agreement among the items of the Korean physical therapist licensing examination, learning objectives of class subjects, and physical therapists' job descriptions. METHODS: The main tasks of physical therapists were classified, and university courses related to the main tasks were also classified. Frequency analysis was used to determine the proportions of credits for the classified courses out of the total credits of major subjects, exam items related to the classified courses out of the total number of exam items, and universities that offer courses related to the Korean physical therapist licensing examination among the surveyed universities. RESULTS: The proportions of credits for clinical decision making and physical therapy diagnosis-related courses out of the total number credits for major subjects at universities were relatively low (2.06% and 2.58%, respectively). Although the main tasks of physical therapists are related to diagnosis and evaluation, the proportion of physiotherapy intervention-related items (35%) was higher than that of examination and evaluation-related items (25%) on the Korean physical therapist licensing examination. The percentages of universities that offer physical therapy diagnosis and clinical decision making-related courses were 58.62% and 68.97%, respectively. CONCLUSION: Both the proportion of physiotherapy diagnosis and evaluation-related items on the Korean physical therapist licensing examination, and the number of subjects related to clinical decision making and physical therapy diagnosis in the physical therapy curriculum, should be increased to ensure that the examination items and physical therapy curriculum reflect the practical tasks of physical therapists.
Clinical Decision-Making ; Curriculum ; Diagnosis ; Humans ; Job Description* ; Korea ; Learning* ; Licensure* ; Physical Therapists*

No abstract available.
Humans ; Korea* ; Patient Safety*

PURPOSE: This study aimed to investigate community pharmacists' knowledge and certainty of adverse effects and contraindications of pharmaceutical products to estimate the risk of error. Factors influencing their knowledge and certainty were also investigated. METHODS: The knowledge of community pharmacists was assessed in a cross-sectional design using a multiple-choice questions test on the adverse effects and contraindications of active pharmaceutical ingredients and excipients from May 2014 to March 2015. Self-rated certainty scores were also recorded for each question. Knowledge and certainty scores were combined to estimate the risk of error. RESULTS: Out of 315 subjects, 129 community pharmacists (41.0%) completed the 30 multiple-choice questions test on active ingredients and excipients. Knowledge on active ingredients was associated with the year of graduation and obtaining a licence to practice pharmacy. Knowledge on excipients was associated with the degree obtained. There was higher risk of error in items on excipients than those on ingredients (P<0.01). CONCLUSION: The knowledge of community pharmacists in Palestine was insufficient with high risk of errors. Knowledge of community pharmacists on the safety issues of active ingredients and excipients need to be improved.
Cross-Sectional Studies ; Excipients* ; Humans ; Pharmaceutical Preparations ; Pharmaceutical Services ; Pharmacists ; Pharmacy

PURPOSE: Upward feedback is becoming more widely used in medical training as a means of quality control. Multiple biases exist, thus the accuracy of upward feedback is debatable. This study aims to identify factors that could influence upward feedback, especially in medical training. METHODS: A systematic review using a structured search strategy was performed. Thirty-five databases were searched. Results were reviewed and relevant abstracts were shortlisted. All studies in English, both medical and non-medical literature, were included. A simple pro-forma was used initially to identify the pertinent areas of upward feedback, so that a focused pro-forma could be designed for data extraction. RESULTS: A total of 204 articles were reviewed. Most studies on upward feedback bias were evaluative studies and only covered Kirkpatrick level 1-reaction. Most studies evaluated trainers or training, were used for formative purposes and presented quantitative data. Accountability and confidentiality were the most common overt biases, whereas method of feedback was the most commonly implied bias within articles. CONCLUSION: Although different types of bias do exist, upward feedback does have a role in evaluating medical training. Accountability and confidentiality were the most common biases. Further research is required to evaluate which types of bias are associated with specific survey characteristics and which are potentially modifiable.
Bias (Epidemiology) ; Confidentiality ; Quality Control ; Social Responsibility

The purpose of this study was to examine the opinions of medical students and physician writers regarding the medical humanities as a subject and its inclusion in the medical school curriculum. Furthermore, we addressed whether an assessment test should be added to the National Medical Licensing Examination of Korea (KMLE). A total of 192 medical students at Inha University and 39 physician writers registered with the Korean Association of Physician Essayists and the Korean Association of Physician Poets participated in this study. They were asked to answer a series of questionnaires. Most medical students (59%) and all physician writers (100%) answered that the medical humanities should be included in the medical school curriculum to train good physicians. They thought that the KMLE did not currently include an assessment of the medical humanities (medical students 69%, physician writers 69%). Most physician writers (87%; Likert scale, 4.38+/-0.78) felt that an assessment of the medical humanities should be included in the KMLE. Half of the medical students (51%; Likert scale, 2.51+/-1.17) were against including it in the KMLE, which they would have to pass after several years of study. For the preferred field of assessment, medical ethics was the most commonly endorsed subject (medical students 59%, physician writers 39%). The most frequently preferred evaluation method was via an interview (medical students 45%, physician writers 33%). In terms of the assessment of the medical humanities and the addition of this subject to the KMLE, an interview-based evaluation should be developed.
Curriculum ; Ethics, Medical ; Humanities* ; Humans ; Korea ; Licensure* ; Schools, Medical ; Students, Medical* ; Surveys and Questionnaires