1.Psychometric properties of self-report questionnaires in evaluating blended learning in health science university students: A systematic review.
Valentin C. DONES III ; Maria Teresita B. DALUSONG ; Donald G. MANLAPAZ ; Juan Alfonso S. ROJAS ; Ma. Bianca Beatriz P. BALLESTEROS ; Ron Kevin S. FLORES ; Kaela Celine C. HO ; Jose Angelo D. MONREAL ; Audrey Marie A. NARCELLES ; Jose Joaquin R. REYES ; Lianna Andrea B. SANGATANAN
Acta Medica Philippina 2025;59(Early Access 2025):1-14
BACKGROUND
Due to the COVID-19 outbreak, schools had to switch online. The sudden transition to blended teaching and learning (BTL) poses challenges for students and teachers, especially for health science programs that require hands-on practical experience. The validity, reliability, and responsiveness of these self-report questionnaires (SRQs) should be established to ensure the accuracy of the results as intended by the SRQ.
OBJECTIVESThis study critically appraised, compared, and summarized the psychometric properties of SRQ evaluating BTL among health science university students. This review determined the SRQ’s reliability, internal consistency, various forms of validity (content, criterion, construct), and responsiveness.
METHODSFollowing a 10-step procedure based on COSMIN guidelines, we conducted a systematic review of SRQs used by health science university students to evaluate blended teaching and learning. Studies were eligible if they reported psychometric properties of SRQs related to blended learning among university health science students; exclusions included studies focusing on perceptions, attitudes, self-efficacy, and satisfaction, as well as articles such as biographies, editorials, and conference materials. Searches covered multiple electronic databases until April 26, 2023, including PubMed, EMBASE, Web of Science, MEDLINE (OVID), PsycInfo, CINAHL, EBSCOHOST, ERIC, Scopus, Science Direct, Google Scholar, JSTOR, Acta Medica Philippina, Philippine Journal of Health Research and Development, and HERDIN, managed through Zotero. Two independent reviewers performed database searches, title and abstract screening, and full-text evaluations, with a third reviewer resolving any disputes. The COSMIN Risk of Bias Checklist was employed to evaluate included studies on the development and various measurement properties of SRQs. The reviewers assessed SRQ standards, including validity, reliability, internal consistency, measurement error, responsiveness, interpretability, and feasibility. Data extraction and result tabulation were independently completed, with content comparison by two health education experts. This evaluation categorized the SRQs into three quality and validity levels.
RESULTSThe study examined five articles; four were rated as 'doubtful' and one as 'inadequate' in the overall development of SRQ. All four 'doubtful' studies demonstrated questionable content validity when university students were asked about the questionnaire's relevance, comprehensiveness, and comprehensibility. Only half of these studies achieved an 'adequate' rating for content validity based on expert opinions on relevance and comprehensiveness. All but one study scored from 'very good' to 'adequate' in structural validity. Three out of the four studies scored a very good rating for internal consistency, while one was deemed 'inadequate' in internal consistency, cross-cultural validity, and reliability. Three out of four studies scored 'very good' on construct validity, but all overlooked criterion validity and responsiveness. Conducted in various locations, including Australia, Romania, Turkey, and Taiwan, these studies highlighted both common characteristics and limitations in questionnaire development according to the COSMIN guidelines. Four studies were deemed reliable and valid for BTL constructs (Category A); Wu et al. requires further validation (Category B). Study limitations included heterogeneity in populations, settings, and questionnaire versions, potential subjective bias in SRQ content comparison, and the evolving nature of SRQs in blended learning contexts.
CONCLUSIONThe systematic review reports the development and evaluation of SRQs for BTL while identifying gaps in their applicability to health science programs. The Blended Learning Scale (BLS) of Lazar et al. and the Blended Learning Questionnaire (BLQ) of Ballouk et al. showed an ‘adequate' rating for content validity. BLS revealed very good structural validity, internal consistency, and adequate content validation. Although the BLQ lacked Confirmatory Factor Analysis, it yielded valuable constructs for evaluating health sciences students' experiences in BTL. Both tools require improvements on recall period, completion time, interpretability, and feasibility. The review underscores the necessity for cont inuous assessment and enhancement of such instruments in BTL, advocating a rigorous scale development process. Furthermore, it encourages the customization of teaching and learning evaluation tools to suit specific institutional contexts while promoting further validation of these questionnaires across different populations in future research.
Human ; Psychometrics ; Checklist ; Self Report ; Universities ; Health Education
2.Evaluation of the report quality of Chinese and English randomized controlled trials of acupuncture based on CONSORT statement and STRICTA checklist.
Wen-Cui XIU ; Xing MENG ; Xiang-Yu HU ; Lan-Jun SHI ; Wei-Juan GANG ; Xiang-Hong JING
Chinese Acupuncture & Moxibustion 2023;43(3):355-361
OBJECTIVE:
To evaluate the report quality of Chinese and English randomized controlled trials (RCTs) of acupuncture based on the CONSORT statement and STRICTA checklist.
METHODS:
The Chinese and English RCTs of acupuncture published from January 1, 2015 to December 31, 2019 were searched in 7 databases including PubMed. The report quality of the included RCTs was evaluated with the CONSORT 2010 statement and STRICTA checklist.
RESULTS:
A total of 506 Chinese RCTs and 76 English RCTs were included. According to the CONSORT statement, in Chinese RCTs, the items with report rate less than 50% accounted for 78.38% of all items, and the report rate of 25 items, such as background and reason, study design, outcome index, and sample size, was less than 10%. In English RCTs, the items with report rate less than 50% accounted for 35.14% of all items, and 5 items had a report rate of less than 10%. The difference of the report rate of 15 items, such as background, reason and study design, was more than 50% between Chinese and English RCTs. The report rate of all items of STRICTA checklist was relatively high in both Chinese and English RCTs. In Chinese RCTs, the items with report rate less than 50% accounted for 29.41% of all items, which included acupuncture rationale and depth of insertion. In English RCTs, only two items had a report rate less than 50%, which were acupuncture rationale, setting and context of treatment. The report rate of five items, including needle retention time, frequency and duration of treatment sessions, details of other interventions administered to the acupuncture group, setting and context of treatment, and precise description of the control or comparator in Chinese RCTs, were higher than in English RCTs.
CONCLUSION
The report quality of Chinese acupuncture RCT needs to be improved urgently, and corresponding measures should be taken to further standardize the writing and reporting of acupuncture clinical research.
Humans
;
Acupuncture Therapy
;
Checklist
;
Randomized Controlled Trials as Topic/standards*
3.Interpretation of Consolidated Health Economic Evaluation Reporting Standards 2022.
Li Yuan TAO ; Ge GAN ; Jue LIU
Chinese Journal of Epidemiology 2023;44(4):667-672
The number of studies related to health economics evaluation is increasing. Consolidated Health Economic Evaluation Reporting Standards 2022 (CHEERS 2022) contains 28 items. Based on CHEERS 2013, CHEERS 2022 adds a health economic analysis plan, model sharing, and community, patient, public, and other relevant stakeholders' participation in the statement, taking into account the future development direction of health economics evaluation. It provides a useful review tool for peer reviewers, editors, and readers and supports health technology assessment agencies in establishing standard reporting standards for health economics evaluations. In this study, we briefly introduced and interpreted the CHEERS 2022 statement and analyzed an example of health economics evaluation in infectious disease epidemiology to provide a reference for researchers to report studies regarding health economics evaluation standardly.
Humans
;
Cost-Benefit Analysis
;
Checklist
;
Economics, Medical
;
Reference Standards
;
Research Report
4.How to report adaptive design randomized trials-A interpretation of international reporting guideline ACE.
Hu Zi Wei ZHOU ; Xue Feng LAI ; Feng SUN ; Munyaradzi DIMAIRO ; Si Yan ZHAN ; Sheng Feng WANG
Chinese Journal of Epidemiology 2022;43(3):409-417
Concerns has been raised in improving the quality of adaptive design randomized trials reports. Based on the CONSORT 2010 (Consolidated Standards of Reporting Trials), The Adaptive designs CONSORT Extension (ACE) has developed items and reporting specifications for adaptive design trials. This paper presents a brief explanation of the extension and new items of ACE and introduces the applications of ACE checklist with examples.
Checklist
;
Humans
;
Randomized Controlled Trials as Topic
;
Research Design
;
Research Report
5.Effectiveness of pre-anesthetic induction checklist in improving general anesthesia induction set-up in a simulated setting during the COVID-19 pandemic
Journal of the Philippine Medical Association 2022;101(1):109-114
Background:
Anesthesiologists being under high
pressure and in a stressful environment may predispose to poor pre-induction preparation. The pre-induction period was identified to be a circumstance where medical errors occur. Thus, routine use of checklists is implemented to prevent these.
Methods:
A Pre-Anesthesic Induction Checklist was formulated and validated by the members of Department of Anesthesiology and Perioperative Medicine staff. The study was designed as a pragmatic trial, quality improvement, and quasi-experimental conducted in the hospital's main operating room in a simulated setting.
The participants included sixteen (16) anesthesiology residents who were divided into two groups, without a checklist and with a checklist, with an equal number of residents per year level who underwent eight simulated general anesthesia induction set-ups each.
Results:
The checklist was used in 64 out of 128 simulations. The group with the checklist had an average completeness score of 95.26% and an average duration of 7.06 minutes compared to the group without the checklist, which had an average score of 70.81% and an average time of 8.75 minutes. Thus, there is an average 24.45% decrease in missed steps and an average 1.69-minute decrease in preparation duration among the residents who used the checklist. In the 128 simulations done, the most common actions and items missed of >20% are the following: Succinylcholine (67.97%), laryngeal mask airways (62.50%), confirmation of identifying factors of patients (55.47%), checking of vaporizer (42.97%), checking of sodasorb (36.72%), checking of breathing circuit (30.47%), video laryngoscope (26.56%), and suction (25.00%).
Conclusion
The mean total duration of preparation and mean completeness score between with checklist and without checklist groups are significantly different, both having a p-value of <0.0001. The Pre-Anesthetic Induction Checklist significantly reduced the number of missed steps and the duration of preparation time of a simulated pre-anesthesia induction period.
Checklist
;
Anesthesia, General
6.Value of autism screening checklists in the early identification of autism spectrum disorder.
Qiu-Hong WEI ; Xiao-Fen XIE ; Jing-Jing DAI ; Yang YU ; Yu ZHANG ; Qian CHENG
Chinese Journal of Contemporary Pediatrics 2021;23(4):343-349
OBJECTIVE:
To evaluate the value of autism screening checklists in the early identification of autism spectrum disorder (ASD).
METHODS:
A total of 2 571 children who attended the Children's Hospital of Chongqing Medical University and completed autism screening and diagnostic test were enrolled as subjects, among whom 2 074 were diagnosed with ASD, 261 were diagnosed with global developmental delay (GDD), 206 were diagnosed with developmental language disorder (DLD), and 30 had normal development. The sensitivity, specificity, and optimal threshold value of the Modified Checklist for Autism in Toddlers (M-CHAT) and the Autism Behavior Checklist (ABC) for the early identification of ASD were evaluated by the receiver operating characteristic (ROC) curve.
RESULTS:
The M-CHAT had a high sensitivity of 88.3% but a low specificity of 36.0% for the identification of ASD. Its sensitivity decreased with age, and was maintained above 80% for children aged 16 to < 48 months. The ABC had a high specificity of 87.3% but a low sensitivity of 27.2%, with an optimal cut-off value of 47.5 based on the ROC curve analysis. The multivariate linear regression model based on a combination of the M-CHAT and ABC for screening of ASD showed a specificity of 85.8% and a sensitivity of 56.6%.
CONCLUSIONS
The M-CHAT has a high sensitivity and a low specificity in the identification of ASD, with a better effect in children aged 16 to < 48 months. The ABC has a high specificity and a low sensitivity. The multiple linear regression model method based on the combined M-CHAT and ABC to screen ASD appears to be effective.
Adolescent
;
Autism Spectrum Disorder/diagnosis*
;
Autistic Disorder
;
Checklist
;
Humans
;
Infant
;
Mass Screening
;
ROC Curve
7.Development and application of quality checklist for the prevention and control of COVID-19 in fever clinic and isolation ward of the general hospital.
Chenping ZHU ; Haixiang ZHU ; Susu HUANG ; Yuhua YUAN ; Yiyu ZHUANG ; Hongying PAN ; Hongxia XU ; Hongfang ZHU ; Huiyin CHEN ; Lili CHENG
Journal of Zhejiang University. Medical sciences 2021;50(1):74-80
To develop a quality control checklist for the prevention and control of coronavirus disease 2019 (COVID-19) in fever clinic and isolation ward of the general hospital and to assess its application. Based on the relevant prevention and control plans and technical guidelines for COVID-19,Delphi method was used to identity items for evaluation,and a quality control checklist for the prevention and control of COVID-19 in the fever clinic and isolation ward was developed in Sir Run Run Shaw Hospital. The checklists included 8 dimensions and 32 items for fever clinic,7 dimensions and 27 items for the isolation ward. The appointed inspectors conducted daily quality control for each shift with this checklist. The expert authority coefficient was 0.88,the mean of the importance of each index in the quality control table was not less than 4.8,and the coefficient of variation was not more than 0.07. During the entire February 2020,8 problems were found and rectified on-the-spot with the application of the checklist. Quality inspection rate was 100% in both isolation wards and fever clinic. The compliance rate and accuracy rate of hand hygiene were 100%; the correct rate of wearing and removing protective equipment increased from 96% to 100%. During the same period,a total of 1915 patients were admitted to the fever clinic,including 191 suspected patients (all were isolated in the hospital,3 were confirmed). There were no medical staff infected with COVID-19,no cross infection of patients and their families in the hospital. A quality control checklist for the prevention and control of COVID-19 has been developed and applied in the isolation wards and fever clinic,which plays an important role in preventing nosocomial infection.
COVID-19
;
Checklist
;
Fever
;
Hospitals, General
;
Humans
;
SARS-CoV-2
8.Long-term participation in community-based group resistance exercises delays the transition from robustness to frailty in older adults: a retrospective cohort study.
Chisato HAYASHI ; Hiromitsu TOYODA ; Soshiro OGATA ; Tadashi OKANO ; Sonoe MASHINO
Environmental Health and Preventive Medicine 2021;26(1):105-105
BACKGROUND:
How community-based group resistance exercises affect the transition from robustness to frailty remains unclear. Thus, we conducted a retrospective cohort study to determine whether the trajectory from robustness to frailty over age differed depending on the duration of participation in group exercises.
METHODS:
We analyzed the Kihon Checklist (KCL) score of community-dwelling elderly residents of Sumoto city, Hyogo prefecture, who participated in community-based group resistance exercises between April 2010 and December 2019. Finally, 2567 older individuals were analyzed using multilevel modeling. The explanatory variables of interest were the frailty score measured using the KCL for each individual, where 0-3, 4-7, and ≥8 points denoted robustness, pre-frailty, and frailty, respectively. We considered age, sex, systolic blood pressure, pulse, duration of participation, and change in KCL score from baseline as possible confounders. Participants were classified as follows based on the duration of participation in the exercises: <3 times, short-term participation group; 4-6 times; mid-term participation group; and 7-13 times, long-term participation group. The mean duration from the baseline physical test for the total sample was 2.35 years (SD=2.51).
RESULTS:
The participants' mean total KCL score at baseline was 4.9±3.7. Multilevel modeling analysis revealed that the KCL scores changed by 0.82 points for each additional year of age (p<0.001) and changed by - 0.93 points for long-term participate group (p<0.001). The Estimated Marginal Means (EMM) of the KCL score was 3.98 (95%CI: 3.69, 4.28) points in the short-term participation group and was significantly worse than that of the long-term participation group at 70 years of age (p=0.001). The EMM was 4.49 (95%CI: 4.24, 4.74) at 75 years of age in the mid-term participation group and was significantly worse than that of the long-term participation group. The EMM was 3.87 (95%CI: 3.57, 4.16) in the long-term participation group and significantly better than that of the short-term (p<0.001) and mid-term (p=0.002) participation groups.
CONCLUSION
Participation in community-based group resistance exercises prolongs the transition from robustness to frailty. The improved KCL scores at baseline in the long-term participation group remained in the robust range at 75 years of age, which suggests the importance of initiating participation before the onset of functional decline.
Aged
;
Checklist
;
Cohort Studies
;
Exercise Test
;
Female
;
Frailty/prevention & control*
;
Humans
;
Independent Living
;
Japan/epidemiology*
;
Male
;
Resistance Training
;
Retrospective Studies
;
Social Participation
9.Development of a patient safety checklist for use during Fluoroscopic or Image-guided, minimally-invasive procedure in the Department of Radiology, Philippine General Hospital
Ryan Jason DL. Urgel ; Imarzen V. Elepano
Acta Medica Philippina 2021;55(7):748-752
Objective:
This study aimed to develop a patient-safety checklist for use during fluoroscopic- or image-guided minimally-invasive procedures in the Department of Radiology, Philippine General Hospital.
Methodology:
A comparison of the Radiological Patient Safety System (RADPASS) and the Cardiovascular and Interventional Society of Europe (CIRSE) checklists was done. Together with the knowledge of the workflow and through observation of the different procedures in the department, a checklist was developed to suit the appropriate hospital setting. This developed checklist was tested in several procedures, and was evaluated and modified during trial testing.
Result:
A patient safety checklist for minimally-invasive and fluoroscopic procedures in the Department of Radiology, Philippine General Hospital was developed through the analysis of the workflow of the department, and observation during the data gathering and trial testing phases.
Conclusion
This simple tool was developed to ensure that all the necessary details before a procedure have been addressed. It has been made as simple as possible, to make it user-friendly. The developed checklist is a step forward in promoting and ensuring the safety of patients undergoing fluoroscopic and minimally-invasive procedures in the Department of Radiology, PGH.
Patient Safety
;
Checklist
;
Radiology
10.Assessment of dietary behaviors among preschoolers in Daejeon: using Nutrition Quotient for Preschoolers (NQ-P)
Hye Jin LEE ; Jin Hee KIM ; SuJin SONG
Journal of Nutrition and Health 2019;52(2):194-205
PURPOSE: The aim of this study was to evaluate the dietary behaviors of preschoolers in Daejeon using the Nutrition Quotient for Preschoolers (NQ-P). METHODS: The study subjects were recruited from child-care centers and kindergartens located in Daedeok-gu, Daejeon between August and September 2018. A total of 411 preschoolers aged 3 ~ 6 years were included in the data analyses. A questionnaire of NQ-P, which consisted of 14 checklist items on dietary behaviors, was completed by the parents or guardians of the study subjects. The NQ-P scores and its three factors, including “balance”, “moderation”, and “environment” factors, were calculated according to sex, age, and weight status. Differences in the NQ-P scores and their factors according to sex, age, and weight status were tested using a student's t-test. RESULTS: The mean NQ-P score of the total subjects was 58.5 ± 9.2, which was within the medium-low grade. The NQ-P score was 58.5 ± 9.4 in boys and 58.6 ± 9.0 in girls (p = 0.955). The NQ-P score was similar regardless of the age groups (57.8 ± 9.4 in 3 ~ 4 years vs. 59.2 ± 9.0 in 5 ~ 6 years, p = 0.124), whereas subjects aged 5 ~ 6 years showed a significantly higher scores of environment factors than those aged 3 ~ 4 years (67.9 ± 16.8 vs. 61.7 ± 17.3). The mean score of the moderation factor was lower in the overweight/obese children compared to the non-overweight/obese children (46.6 ± 13.3 vs. 51.0 ± 16.2, p = 0.012). Compared to children aged 3 ~ 4 years, children aged 5 ~ 6 years had higher intakes of vegetable dishes and processed meat. The overweight/obese group showed a higher consumption of processed beverages than the non-overweight/obese group. CONCLUSION: The current study indicates that the dietary behaviors of preschoolers residing in Daejeon need to be improved. These findings suggest that nutrition education or health interventions targeting young children is necessary for improving their nutritional health status.
Beverages
;
Checklist
;
Child
;
Child, Preschool
;
Education
;
Feeding Behavior
;
Female
;
Food Habits
;
Humans
;
Meat
;
Parents
;
Statistics as Topic
;
Vegetables


Result Analysis
Print
Save
E-mail