1.Small-Group Survey of Patient Services in Hygiene and Public Health.
Katsuhiko OGASAWARA ; Akira ENDOH ; Hitomi SATO ; Satoshi TERAE ; Tsunetaro SAKURAI
Medical Education 2000;31(1):23-28
Small groups of 5th-year medical students performed a survey of hospital patient services in hygiene and public health, with an emphasis on patient waiting time. The purpose of this course was to give medical students the opportunity to experience the waiting time endured by patients and to obtain some understanding of the quality of hospital services from the patient's point of view. The survey was performed as follows. Groups of five students accompanied new patients in the department of internal medicine from registration until payment. The students recorded waiting time and examination time. During the waiting time, the students asked the patient questions to evaluate service. Patients were cooperative in giving responses during the survey. After the survey, the students summary proposed how to improve services for patients. By accompanying and talking with patients, the medical students were able to understand hospital systems from the patient's point of view. This course should prove useful for these students future careers in medicine.
2.Events related to medication errors and related factors involving nurses’ behavior to reduce medication errors in Japan: a Bayesian network modeling-based factor analysis and scenario analysis
Naotaka SUGIMURA ; Katsuhiko OGASAWARA
Journal of Educational Evaluation for Health Professions 2024;21(1):12-
Purpose:
This study aimed to identify the relationships between medication errors and the factors affecting nurses’ knowledge and behavior in Japan using Bayesian network modeling. It also aimed to identify important factors through scenario analysis with consideration of nursing students’ and nurses’ education regarding patient safety and medications.
Methods:
We used mixed methods. First, error events related to medications and related factors were qualitatively extracted from 119 actual incident reports in 2022 from the database of the Japan Council for Quality Health Care. These events and factors were then quantitatively evaluated in a flow model using Bayesian network, and a scenario analysis was conducted to estimate the posterior probabilities of events when the prior probabilities of some factors were 0%.
Results:
There were 10 types of events related to medication errors. A 5-layer flow model was created using Bayesian network analysis. The scenario analysis revealed that “failure to confirm the 5 rights,” “unfamiliarity with operations of medications,” “insufficient knowledge of medications,” and “assumptions and forgetfulness” were factors that were significantly associated with the occurrence of medical errors.
Conclusion
This study provided an estimate of the effects of mitigating nurses’ behavioral factors that trigger medication errors. The flow model itself can also be used as an educational tool to reflect on behavior when incidents occur. It is expected that patient safety education will be recognized as a major element of nursing education worldwide and that an integrated curriculum will be developed.
3.ChatGPT (GPT-4) passed the Japanese National License Examination for Pharmacists in 2022, answering all items including those with diagrams: a descriptive study
Hiroyasu SATO ; Katsuhiko OGASAWARA
Journal of Educational Evaluation for Health Professions 2024;21(1):4-
Purpose:
The objective of this study was to assess the performance of ChatGPT (GPT-4) on all items, including those with diagrams, in the Japanese National License Examination for Pharmacists (JNLEP) and compare it with the previous GPT-3.5 model’s performance.
Methods:
The 107th JNLEP, conducted in 2022, with 344 items input into the GPT-4 model, was targeted for this study. Separately, 284 items, excluding those with diagrams, were entered into the GPT-3.5 model. The answers were categorized and analyzed to determine accuracy rates based on categories, subjects, and presence or absence of diagrams. The accuracy rates were compared to the main passing criteria (overall accuracy rate ≥62.9%).
Results:
The overall accuracy rate for all items in the 107th JNLEP in GPT-4 was 72.5%, successfully meeting all the passing criteria. For the set of items without diagrams, the accuracy rate was 80.0%, which was significantly higher than that of the GPT-3.5 model (43.5%). The GPT-4 model demonstrated an accuracy rate of 36.1% for items that included diagrams.
Conclusion
Advancements that allow GPT-4 to process images have made it possible for LLMs to answer all items in medical-related license examinations. This study’s findings confirm that ChatGPT (GPT-4) possesses sufficient knowledge to meet the passing criteria.