1.Development of Evaluation Indicators for Drug Information Websites Serving Patients and General Consumers
Ken YAMAMOTO ; Kyoko KITAZAWA ; Tsugumichi SATO ; Mitsuo SAITO ; Hiromi TAKANO-OHMURO ; Yuki KAJI ; Takeo NAKAYAMA ; Michiko YAMAMOTO
Japanese Journal of Drug Informatics 2025;27(3):105-115
Objective: With the Internet serving as a major source of medical information, the abundance of pharmaceutical content across media and digital platforms raises concerns about the impact of inappropriate or misleading information on public health. This study aimed to develop a comprehensive, practical evaluation indicator to assess the reliability and quality of pharmaceutical websites, targeting general consumers in Japan.Methods: We systematically reviewed existing domestic and international criteria for health information quality to develop evaluation indicators. Based on this review, a preliminary set of indicators was drafted and refined using a modified Delphi process involving six experts in pharmaceutical and medical communications. This process incorporated established frameworks, including the Health on the Net (HON) Code, JAMA Benchmarks, and the Japanese eHealth Ethics Code. A validated set of indicators was finalized after four iterative rounds of review and feedback.Results: The final tool comprises 16 evaluation items across three categories: (1) Screening Criteria (4 items), which eliminate websites with misleading content, public indecency, or political/religious affiliations; (2) Website Evaluation Criteria (5 items), assessing operational transparency, contact availability, advertisement distinction, and policy disclosure; and (3) Content Evaluation Criteria (7 items), addressing clarity, accuracy, update frequency, source citation, legal compliance, and balanced risk-benefit information. Each item was rated using a primarily binary (yes/no) scale with intermediate options, such as “partially applicable” or “not applicable.” The tool reflects expert consensus and complies with Japan’s ethical and regulatory standards.Conclusion: This tool facilitates the appropriate dissemination of pharmaceutical information and supports users in identifying trustworthy sources. By explicitly incorporating legal compliance and editorial transparency as evaluation criteria, it encourages higher standards among healthcare professionals and information providers, potentially improving the quality of pharmaceutical communication.
2.Evaluation of Newspaper Stories on Drug Therapy with “Media Doctor” Instrument
Kyoko KITAZAWA ; Masae SATO ; Kiyotaka WATANABE ; Michiko YAMAMOTO
Japanese Journal of Drug Informatics 2019;21(3):109-115
Objective: The objective of this study was to examine information quality by quantitatively evaluating newspaper stories on drug therapy using the “Media Doctor” instrument.Methods: A database search was conducted to extract newspaper stories on drug therapy published between July 1, 2017 and December 31, 2017. Two evaluators independently evaluated each story using the “Media Doctor” instrument. Each of the 10 evaluation criteria were rated as “satisfactory” or “not satisfactory.” When the content of the story was not suitable for the evaluation criteria, it was regarded as “not applicable”.Results: Fifty-nine news stories (Asahi: 13, Mainichi: 8, Nikkei: 8, Sankei: 14, Yomiuri: 16) were included. The median number of evaluation criteria that the two evaluators judged as “satisfactory” was 5. The proportions of stories that the two evaluators judged as satisfactory were “1. availability,” 73%; “2. novelty,” 66%; “3. alternatives,” 39%; “4. disease mongering,” 58%; “5. evidence,” 32%; “6. quantification of benefits,” 31%; “7. harm,” 41%; “8. cost,” 22%; “9. sources of information/conflict of interest,” 12%; and “10. headline,” 66%. Conversely, the proportions of stories judged as “not satisfactory” were “1. availability,” 0%; “2. novelty,” 5%; “3. alternatives,” 12%; “4. disease mongering,” 8%; “5. evidence,” 24%; “6. quantification of benefits,” 29%; “7. harm,” 41%; “8. cost,”44%; “9. sources of information/conflict of interest,” 32%; and “10. headline,” 12%.Conclusion: These results suggest that the quality of newspaper stories are insufficient as drug information in terms of the validity of its scientific evidence.
3.An Evaluation of News Reporting on Health in U.K. and Japanese Mass Media using the Media Doctor Australia Rating Instrument
Japanese Journal of Pharmacoepidemiology 2008;13(2):71-78
Objectives : To evaluate health stories from several representative news websites in the U.K. and in Japan with the Media Doctor Australia rating instrument in order to contrast the strength and weakness of Japanese health stories with that of U.K. ones.
Design :Cross-sectional study
Methods : Stories describing treatment or prevention of diseases published between January and June 2007 were retrieved from U.K. (BBC, Guardian, Independent, Times, Yahoo! UK,) and Japanese (Asahi, Yomiuri, Yahoo! Japan,) websites which specialize in health / medical news. The quality of retrieved stories was examined with an instrument developed by Media Doctor Australia. Overall score was contrasted between two countries.
Results : 296 U.K. stories and 79 Japanese stories were retrieved. The overall score by media outlet ranged between 45.7 (Asahi) and 63.4 (Independent) out of 100. When all outlets were pooled, U.K. stories (average overall score 60.0, 95%CI 58.2-61.8) were rated significantly higher than Japanese stories (47.8, 95%CI 45.4-50.2) (p<0.001).
Conclusion : Stories reviewed in this study did not provide satisfactory information from the viewpoint of Media Doctor Australia. This suggests that journalists and health service researchers can help each other for the better dissemination of health information to the general public.


Result Analysis
Print
Save
E-mail