1.Objective Structured Clinical Examination for Essential Neurological Examination. Validation and Association Between the Score and the Learning Behaviors.
Hirotaka ONISHI ; Yasutomo ODA ; Sei EMURA ; Seiji YAMASHIRO ; Shunzo KOIZUMI
Medical Education 2000;31(4):265-270
Objective: To investigate the role and validity of the objective structured clinical examination (OSCE) for neurological screening (Neuro-OSCE) performed by medical students and to analyze the association between Neuro-OSCE score and student behavior for acquiring skills. Method: A 31-item Neuro-OSCE was created for systematic and time-saving screening of neurological findings. At Saga Medical School, 44 final-year students took a screening neurological examination course and performed Neuro-OSCE from August through October 1998. A questionnaire asked about self-educational behaviors, such as self-evaluation, mental concentration, and self-learning (knowlege-based), and self-practicing time. The relationship between Neuro-OSCE score and self-educational behaviors were analyzed. statistically. Results: Cronbach's coefficient alpha was 0.731, which indicated fair internal validity. The mean Neuro-OSCE score was 51.2± 6.6 (SD). Neuro-OSCE score was correlated with self-practicing time and mental concentration but not with self-learning time or self-evaluation. Conclusion: Our Neuro-OSCE has construct validity in the psychomotor domain from a taxonomic viewpoint because the Neuro-OSCE score was correlated with self-practicing time rather than self-learning time. Mental concentration was better a self-assessment method than was self-evaluation. However, setting self-educational goals for neurological examination is probably too difficult at the undergraduate level. Objective assessment by Neuro-OSCE is expected to foster relevant learning behavior.
2.The Assessment of Undergraduate Curriculum of Communication Skills Evaluated by Performance Measurement Using Actual Outpatient Satisfaction
Yasutomo Oda ; Hirotaka Onishi ; Seiji Yamashiro ; Shunzo Koizumi
General Medicine 2003;4(1):1-6
OBJECTIVE: To evaluate an undergraduate curriculum of communication skills by measuring satisfaction of outpatients whom final year students had examined.
METHODS: Cross-sectional surveys were conducted in General Medicine Clinic (GMC) of Saga Medical School (SMS) Hospital in 1999 and 2001. After the clinical clerkship in wards in fifth year, final year students experienced the two-week GMC clerkship, including seven hours of small group lecture in 1999, but partly converted into eight hours of small group discussion with a tutor in 2001. Six items in American Board of Internal Medicine Patient Satisfaction Questionnaire were selected as a validated instrument and incorporated into repeated measures ANOVA.
RESULTS: A total of 177 students were evaluated by 688 outpatients. Overall average score was 3.49+/-0.82. Average score in 2001 was significantly higher than that in 1999 (p<0.001; 3.58+ /-0.76vs 3.36+/-0.87) . The scores of“encouraging and answering questions”and“clear explanations”items were significantly lower than those of other items (3.21+/-0.98 and 3.37+/-0.92; Least Significant Difference) . The interaction between gender and years of curricula (1999 and 2001) was significant (p<0.001) ; female students showed remarkable improvement from 1999 to 2001 (Cohen's delta=0.67) .
CONCLUSIONS: Patient satisfaction scores indicated that undergraduate curriculum for communication skills in SMS improved from 1999 to 2001. Newly implemented small group discussion was a possible reason for the improvement, especially in female students. Further training for the skills of encouraging and answering questions and clear explanations will be the next step.
3.The Role of COOP/WONCA Charts in Predicting Psychological Distress in Patients with Medically Unexplained Symptoms and Doctor-shopping Behavior
Masahiko Yamada ; Kenji Ishii ; Yasutomo Oda ; Sei Emura ; Shunzo Koizumi
General Medicine 2006;7(1):9-14
BACKGROUND: Prior research indicates that patients with medically unexplained symptoms and doctorshopping behavior are more likely to have psychological distress. In patients with somatic symptoms, we hypothesized that high scores on COOP/WONCA Functional Assessment Charts, in addition to the presence of medically unexplained symptoms and doctor-shopping behavior, might have an important role in diagnosing psychological distress.
METHODS: Between November 2002 and March 2003, the patients who presented themselves to the hospital for the first time with somatic symptoms were enrolled in this study. In this study, we defined psychological distress as disease conditions, including Mood disorders, Anxiety disorders, Adjustment disorders, and Somatoform disorders, according to the Diagnostic and Statistical Manual of Mental Disorders, Fourth edition (DSM-IV) . Symptoms that, in the doctor's judgment, could not be medically explained were regarded as medically unexplained symptoms. Doctor shopping was defined as those patients with a complaint of sustained and unsolved symptoms for more than one month who had visited two or more medical facilities prior to visiting our hospital and arrived without any physician's referral.
RESULTS: One hundred and six patients out of 496 were diagnosed as having psychological distress. Among these 106 patients, 49 (46.2%) had doctorshopping behavior, 86 (81.1%) had medically unexplained symptoms, and 95 (89.6%) showed high scores on COOP/WONCA charts. Odds ratios and 95% confidence intervals of medically unexplained symptoms and doctor shopping were 24.12 (11.91-48.84) and 4.18 (2.16-8.07), respectively. High scores on COOP/WONCA charts 2, 3 and 6 were significantly associated with the presence of psychological distress, and the odds ratios (95% confidence intervals) of these three items were 1.41 (1.01-1.98), 1.41 (1.02-1.94), and 2.88 (1.68-4.95), respectively.
Positive and negative likelihood ratios for 4 items (i.e., age of not less than 45 years; duration of symptoms of not less than 6 months, ; doctorshopping behavior; and, medically unexplained symptoms) were 1.16 and 0.85; 1.43 and 0.55; 3.16 and 0.63; and, 3.96 and 0.24, respectively. Positive and negative likelihood ratios for high scores on COOP/WONCA charts were 1.42 and 0.28. Under ROC curves for the diagnosis of psychological distress, the information of COOP/WONCA charts, in addition to that of clinical data, medically unexplained symptoms, and doctor shopping behavior, increased the accuracy in diagnosing psychological distress.
CONCLUSIONS: In patients with somatic symptoms, COOP/WONCA charts increased diagnostic accuracy in predicting psychological distress when patients showed sustained symptoms for more than 6 month, doctor shopping, and medically unexplained symptoms.
4.Evaluating an Undergraduate Curriculum for Communication Skills by Assessing Outpatient Satisfaction
Yasutomo ODA ; Hirotaka ONISHI ; Sei EMURA ; Masahiko YAMADA ; Seiji YAMASHIRO ; Shunzo KOIZUMI
Medical Education 2004;35(2):89-94
A cross-sectional study was performed in the general medicine clinic of Saga Medical School Hospital to evaluate the humanistic quality of the clinical curriculum by assessing Patient satisfaction. The Patient Satisfaction Questionnaire (PSQ) developed by the American Board of Internal Medicine, was translated into Japanese, and 6 of 10 items were selected to evaluate the humanistic qualities of 123 fourth-year medical students who performed medical interviews of 442 patients. The patients rated each PSQ item with a 5-point scale from poor to excellent. The mean PSQ score was 3.38±0.66 (good to very good). The scores for “answering questions” and “giving clear explanations” were significantly lower than were scores for attitudinal aspects. The results suggest that the undergraduate curriculum at Saga Medical School for patient education skills requires further improvement.
5.Humanistic Quality Ratings for Medical Students: an Association with Actual Patient Satisfaction in a Outpatient Clinic
Seiji Yamashiro ; Yasutomo Oda ; Hirotaka Onishi ; Takeru Shimada ; Sei Emura ; Toshinobu Takashima ; Shunji Imanaka ; Shunzo Koizumi
General Medicine 2000;1(1):17-21
PURPOSE: To determine whether faculty humanistic quality ratings for medical students in an Objective Structured Clinical Examination (OSCE) are associated with student OSCE scores and actual patient satisfaction in a university hospital outpatient (general internal medicine) clinic.
METHODS: Our study was conducted on final-year (sixth grade) medical students in 1998. Forty medical students took the OSCE and were evaluated by faculty internists for humanistic qualities during OSCE sessions. Patient satisfaction ratings for students were also obtained in an outpatient clinic by using six items from the American Board of Internal Medicine Patient Satisfaction Questionnaire (PSQ) . A total of 40 students were evaluated by 117 patients. A multiple regression analysis was used for this study.
RESULTS: In the OSCE, faculty humanistic quality ratings for students were associated with interview skills (p=0.004), but not with physical examination scores nor students' gender. However, patient satisfaction ratings were not statistically associated with faculty humanistic quality ratings for students, other OSCE scores nor with patients' demographic characteristics such as age, sex, occupation and education levels.
CONCLUSIONS: Faculty humanistic quality ratings for medical students taking the OSCE were not significantly associated with patient satisfaction at the outpatient clinic in our study.
6.Mixed-Method Outcome Evaluation of a Community-Based Education Program for Medical Students
Makoto Kikukawa ; Yasutomo Oda ; Kenji Ishii ; Maiko Ono ; Hiromi Nabeta ; Motofumi Yoshida ; Sei Emura ; Shunzo Koizumi ; Takanobu Sakemi
General Medicine 2014;15(1):21-28
Background: Although community-based training is included in medical undergraduate education in Japan, little assessment of the outcomes of community-based education programs has been performed. The aim of this study was to investigate the outcomes of a community-based education program using a mixed method.
Methods: The study design utilized both qualitative and quantitative methods (mixed method). The subjects (n = 278) were fifth-grade medical students who were involved in the program from 2008 to 2010 inclusive. We collected two types of data: a six-item pre-and-post questionnaire (quantitative) and an open-ended questionnaire (qualitative) to evaluate the impressions this experience left on the students.
Results: Pre-and-post questionnaires were completed by 263 (95%) of 278 subjects; on all items, the scores of the post- data were significantly higher than that of pre- data (P < 0.001). From the responses given by 139 respondents (total 181, 77%) in the open-ended questionnaire survey, 10 themes were extracted: 1. Inter-professional cooperation; 2. Role and cooperation among university hospitals, community hospitals, clinics, and welfare facilities; 3. Patient-centered medicine; 4. Trust-based relationships; 5. Competency in general medicine; 6. Professionalism; 7. Medical management; 8. Communication; 9. Common diseases; and 10. Long-term care.
Conclusions: We found that medical students gained four major perspectives from their experiences: Inter-professional cooperation, trust based relationships, roles of community hospitals and clinics, and patient-centered medicine, respectively. Our findings suggest this program contributed significantly to their understanding of community medicine.
7.Issues to conduct randomized controlled trials in medical education area
Hirotaka ONISHI ; Atsushi WATANABE ; Hirono ISHIKAWA ; Yasutomo ODA ; Sugimoto SUGIMOTO ; Rika MORIYA ; Motofumi YOSHIDA ; Takeshi MORIMOTO ; Akinobu YOSHIMURA ; Ryoko ASO ; Toshiro SHIMURA
Medical Education 2010;41(1):65-71
1) We conducted a randomized controlled trial in medical education area and explored practical issues through reflection on the processes.
2) In February 2007, 39 fourth-year medical students in Nippon Medical School listened to the lecture about how to ask key questions for the diagnosis. Shortly after they had medical interview with a standardized patient for measurement purpose. They were randomly allocated to study and control groups. The lecture content for the intervention group corresponded to the interview but the one for the control group did not correspond to the interview.
3) We identified the issues related with ethical review for research, how to mask the information of randomization out of assessors, and equity of educational intervention and assessment offered to both groups.