BACKGROUND

Due to the COVID-19 outbreak, schools had to switch online. The sudden transition to blended teaching and learning (BTL) poses challenges for students and teachers, especially for health science programs that require hands-on practical experience. The validity, reliability, and responsiveness of these self-report questionnaires (SRQs) should be established to ensure the accuracy of the results as intended by the SRQ.

This study critically appraised, compared, and summarized the psychometric properties of SRQ evaluating BTL among health science university students. This review determined the SRQ’s reliability, internal consistency, various forms of validity (content, criterion, construct), and responsiveness.

Following a 10-step procedure based on COSMIN guidelines, we conducted a systematic review of SRQs used by health science university students to evaluate blended teaching and learning. Studies were eligible if they reported psychometric properties of SRQs related to blended learning among university health science students; exclusions included studies focusing on perceptions, attitudes, self-efficacy, and satisfaction, as well as articles such as biographies, editorials, and conference materials. Searches covered multiple electronic databases until April 26, 2023, including PubMed, EMBASE, Web of Science, MEDLINE (OVID), PsycInfo, CINAHL, EBSCOHOST, ERIC, Scopus, Science Direct, Google Scholar, JSTOR, Acta Medica Philippina, Philippine Journal of Health Research and Development, and HERDIN, managed through Zotero. Two independent reviewers performed database searches, title and abstract screening, and full-text evaluations, with a third reviewer resolving any disputes. The COSMIN Risk of Bias Checklist was employed to evaluate included studies on the development and various measurement properties of SRQs. The reviewers assessed SRQ standards, including validity, reliability, internal consistency, measurement error, responsiveness, interpretability, and feasibility. Data extraction and result tabulation were independently completed, with content comparison by two health education experts. This evaluation categorized the SRQs into three quality and validity levels.

The study examined five articles; four were rated as 'doubtful' and one as 'inadequate' in the overall development of SRQ. All four 'doubtful' studies demonstrated questionable content validity when university students were asked about the questionnaire's relevance, comprehensiveness, and comprehensibility. Only half of these studies achieved an 'adequate' rating for content validity based on expert opinions on relevance and comprehensiveness. All but one study scored from 'very good' to 'adequate' in structural validity. Three out of the four studies scored a very good rating for internal consistency, while one was deemed 'inadequate' in internal consistency, cross-cultural validity, and reliability. Three out of four studies scored 'very good' on construct validity, but all overlooked criterion validity and responsiveness. Conducted in various locations, including Australia, Romania, Turkey, and Taiwan, these studies highlighted both common characteristics and limitations in questionnaire development according to the COSMIN guidelines. Four studies were deemed reliable and valid for BTL constructs (Category A); Wu et al. requires further validation (Category B). Study limitations included heterogeneity in populations, settings, and questionnaire versions, potential subjective bias in SRQ content comparison, and the evolving nature of SRQs in blended learning contexts.

The systematic review reports the development and evaluation of SRQs for BTL while identifying gaps in their applicability to health science programs. The Blended Learning Scale (BLS) of Lazar et al. and the Blended Learning Questionnaire (BLQ) of Ballouk et al. showed an ‘adequate' rating for content validity. BLS revealed very good structural validity, internal consistency, and adequate content validation. Although the BLQ lacked Confirmatory Factor Analysis, it yielded valuable constructs for evaluating health sciences students' experiences in BTL. Both tools require improvements on recall period, completion time, interpretability, and feasibility. The review underscores the necessity for cont inuous assessment and enhancement of such instruments in BTL, advocating a rigorous scale development process. Furthermore, it encourages the customization of teaching and learning evaluation tools to suit specific institutional contexts while promoting further validation of these questionnaires across different populations in future research.

Background: There are various attitudes regarding their child's screen usage. However, there are no existing Filipino-translated and culturally appropriate questionnaires or assessment tools that can measure a child's media exposure, screen use, and parental attitude. The Media Exposure Survey is an assessment tool that measures a child’s media exposure, screen use, and parental attitudes regarding their child’s screen usage. Objectives: The study aims to contextualize and translate the questionnaire into Filipino, determine its content validity and internal consistency, and check the translated questionnaire's compatibility and applicability. Methods: The study involves four steps: 1) content validity testing, 2) forward and backward translation and equivalence, 3) pilot testing of the pre-final version, and 4) reliability resting. Data analysis was done to evaluate the content validity and internal consistency of the questionnaire. Thirty-six parents of children aged 0-5 in Metro Manila pilot tested the tool. Results: A cross-culturally adapted version of the Media Exposure Survey has been produced with good content validity. The S-CVI of the questionnaire is 95%, which is excellent. The parental attitude towards childhood media use subscale has an acceptable internal consistency with a Cronbach's alpha of 0.77. Conclusion The translated and adapted Media Exposure Survey has good content validity and acceptable internal consistency and can be used to assess Filipino children’s media exposure, screen use, and parental attitudes toward media use.
Surveys and Questionnaires ; Screen Time ; Psychometrics

BACKGROUND: Menopausal disorders include obscure symptomatology that greatly reduce work productivity among female workers. Quantifying the impact of menopause-related symptoms on work productivity is very difficult because no such guidelines exist to date. We aimed to develop a scale of overall health status for working women in the perimenopausal period. METHODS: In September, 2021, we conducted an Internet web survey which included 3,645 female workers aged 45-56 years in perimenopausal period. We asked the participants to answer 76 items relevant to menopausal symptomatology, that were created for this study and performed exploratory and confirmatory factor analyses for the scale development. Cronbach's alpha, receiver operating characteristic analysis, and logistic regression analysis were used to verify the developed scale. RESULTS: Approximately 85% participants did not have menstruation or disrupted cycles. Explanatory factor analysis using the maximum likelihood method and Promax rotation identified 21 items with a four-factor structure: psychological symptoms (8 items, α = 0.96); physiological symptoms (6 items, alpha = 0.87); sleep difficulty (4 items, alpha = 0.92); human relationship (3 items, alpha = 0.92). Confirmatory factor analyses found excellent model fit for the four-factor model (RMSR = 0.079; TLI = 0.929; CFI = 0.938). Criterion and concurrent validity were confirmed with high correlation coefficients between each of the four factors, previously validated menopausal symptom questionnaire, and Copenhagen Burnout Inventory scales, respectively (all ps < 0.0001). The developed scale was able to predict absenteeism with 78% sensitivity, 58% specificity, and an AUC of 0.727 (95%CI: 0.696-0.757). Higher scores of each factor as well as total score of the scale were more likely to be associated with work absence experience due to menopause-related symptoms even after adjusting for Copenhagen Burnout Inventory subscales (all ps < 0.0001). CONCLUSION We found that the developed scale has high validity and reliability and could be a significant indicator of absenteeism for working women in perimenopausal period.
Humans ; Female ; Perimenopause ; Reproducibility of Results ; Menopause/psychology* ; Workplace ; Surveys and Questionnaires ; Psychometrics

To develop a caregiver parenting behavior scale for children aged 2 to 6 years, and to verify its reliability and validity. This study recruited 1 350 caregivers of children aged 2 to 6 years. The item discrimination analysis and exploratory factor analysis were used to analyze the structure, dimensions and items of the scale. Homogeneity reliability, split-half reliability and test-retest reliability were used to analyze the reliability of the scale. Content validity and construct validity were used to analyze the validity of the scale. The results showed that the final scale contained 7 dimensions and 45 items. Cronbach's α coefficient of the total scale was 0.945; the coefficient of split half was 0.899; the test-retest reliability analysis showed that the correlation coefficients between the two tests were 0.893 (total score), 0.854 (social), 0.832 (language), 0.871 (gross motor), 0.893 (fine motor), 0.862 (cognitive), 0.832 (self-care), and 0.872 (sensory). The content validity analysis was carried out by two rounds of expert argumentation using Delphi expert consultation method. The Kendall coefficient of the items score in two rounds of Delphi expert consultation was 0.813 (P<0.01). The structure validity analysis showed that there were significant correlations between each dimension and the total scale, also between each dimension of the scale, and the extracted average variance values of each dimension was greater than the correlation coefficients between this dimension and other dimensions. In conclusion, the reliability and validity of the scale are qualified. It can be used as a tool to evaluate and guide the parenting behavior of caregivers of children aged 2 to 6 years.
Humans ; Child ; Caregivers/psychology* ; Reproducibility of Results ; Parenting ; Surveys and Questionnaires ; Factor Analysis, Statistical ; Psychometrics/methods*

OBJECTIVES: The development and validation of the specific health literacy assessment tool for older adults is the basis for conducting the research on health literacy among older adults. The existing health literacy assessment scale for older adults in Chinese mainland has some limitations, such as too many items and poor compliance during the survey. It is necessary to develop or introduce simplified assessment tools to support large-scale surveys in the future. This study aims to modify the brief health literacy assessment scale compiled by Taiwan scholars, and to conduct the test for the reliability, validity and the measurement equivalence across gender in the older population in mainland China. METHODS: From March to April 2021, 508 older adults from Jinan, Shandong Province, China were selected by cluster sampling method to conduct a questionnaire survey using the brief health literacy assessment scale and health-promoting lifestyle profile. After 4 weeks, 83 of them were selected for retesting. SPSS 25.0 statistical software was used for descriptive analysis, item analysis, exploratory factor analysis, correlation analysis, and reliability test, and Mplus 8.0 was used for confirmatory factor analysis and gender measurement equivalence test. RESULTS: Each item of the scale had good discrimination, and there were significant differences in the scores of each item between high score and low score groups (P<0.05), and the coefficient of correlation between the scores of each item and the total score was between 0.721 and 0.891. Exploratory factor analysis extracted a factor with a characteristic root greater than 1, and the cumulative variance interpretation amount was 67.94%. The confirmatory factor analysis showed that the single factor structure fit was good [χ2/df was 2.260, the Tucker-Lewis index was 0.973, the comparison fit index (CFI) was 0.982, and the root mean square error of approximation (RMSEA) was 0.071]. The multi-group confirmatory factor analysis results showed that the brief health literacy assessment scale's configural equivalence, weak equivalence, and strong equivalence models were all accepted. The comparison results of measurement equivalence models showed that the changes of RMSEA were less than 0.015, and the changes of CFI were less than 0.01, indicating that the brief health literacy assessment scale had measurement equivalence between different gender groups. Cronbach's α coefficient was 0.945, and the test-retest reliability was 0.946. The correlation coefficient between health literacy and health-promotion lifestyles was 0.557 (P<0.05). CONCLUSIONS The brief health literacy assessment scale has good reliability, validity, and measurement equivalence across gender, and can be used as an effective measurement tool for the health literacy of the older people in Chinese mainland.
Humans ; Aged ; Reproducibility of Results ; Health Literacy/methods* ; Psychometrics ; Surveys and Questionnaires ; Asian People ; China ; Factor Analysis, Statistical

OBJECTIVE: To test the reliability and validity of the Chinese version of adverse childhood experiences international questionnaire (ACE-IQ) in Chinese parents of preschool children. METHODS: The parents of preschool children in 6 kindergartens in Tongzhou District of Beijing were selected by stratified random cluster sampling, and the Chinese version of ACE-IQ after translation and adaptation was used for survey online. The collected data were randomly divided into two parts. One part of the data (n=602) was used for exploratory factor analysis (EFA), to screen items and evaluate structural validity, and then form the final Chinese version of ACE-IQ. The other part of the data (n=700) was used for confirmatory factor analysis (CFA), criterion validity analysis and reliability analysis. At the same time, experts investigation method was used to evaluate the content validity of the final Chinese version of ACE-IQ. RESULTS: After deleting four items of collective violence, the Chinese version of ACE-IQ with twenty-five items indicated good structural, criterion and content validity. Analysis results showed that the Chinese version of ACE-IQ presented a seven-factor model dimension, namely emotional neglect, physical neglect, family dysfunction, family violence, emotional and physical abuse, sexual abuse and violence outside the home, and the total score of the binary version of ACE-IQ Chinese version was positively correlated with the total score of childhood trauma questionaire-28 item short form (CTQ-SF, r=0.354, P < 0.001) and the center for epidemiological studies depression scale (CES-D, r=0.313, P < 0.001) respectively. Results from five experts showed that the item-level content validity index (I-CVI) of 25 items was between 0.80 and 1.00, and the average of all I-CVIs on the scale (S-CVI/Ave) of the scale was 0.984. At the same time, the internal consistency (Cronbach's α coefficient) of the whole scale was 0.818, and the split-half reliability (Spearman-Brown coefficient) was 0.621, which demonstrated good reliability. CONCLUSION This study has formed a Chinese version of ACE-IQ with 25 items and 7 dimensions, which has good reliability and validity among the parents of preschool children in China. It can be used as an evaluation instrument for measuring the minimum threshold of the adverse childhood experiences in the parents of preschool children in the cultural background of China.
Humans ; Child, Preschool ; Adverse Childhood Experiences ; Reproducibility of Results ; Parents/psychology* ; Surveys and Questionnaires ; China ; Psychometrics/methods*

Hepatic encephalopathy (HE) is a common serious complication of liver cirrhosis, with sudden onset, indicating a poor prognosis in patients with chronic liver disease. Minimal hepatic encephalopathy (MHE) is an early stage of HE with no apparent symptoms, but it shows abnormal results in neuropsychological and/or neurophysiological tests. MHE affects patients' quality of life, employability, driving ability, and has a high risk of developing overt hepatic encephalopathy (OHE). This article aims to explore various diagnostic methods, strengthen the routine work of clinicians in diagnosis and treatment, and develop an effective MHE screening protocol.
Hepatic Encephalopathy/diagnosis* ; Humans ; Liver Cirrhosis/diagnosis* ; Liver Diseases ; Mass Screening ; Neuropsychological Tests ; Psychometrics ; Quality of Life

To explore and revise the factor structure, reliability and validity of the Chinese version of the Driver Stress Inventory (DSI) in the driver population in first-tier city of China. In this study, the questionnaire method was used to select the data collected by the "Research on the Driving Stress of Urban Salaries in Urban Traffic" carried out by the Institute of Psychology, Chinese Academy of Sciences in 2012, and a third-party survey agency was commissioned to select 300 people in Beijing, Shanghai, and Guangzhou respectively. A total of 900 drivers (with 889 valid data scales) were used to test their driving stress and other indicators by using the DSI and the self-compiled travel and stress relief scale. The test content collects driver self-reported stress data from five dimensions: Aggression, Dislike of driving, Hazard-Monitoring, Fatigue Proneness and Thrill-seeking. The DSI questionnaire of 445 cardinal numbers was revised by item analysis methods such as correlation test and T-test, and exploratory factor analysis method based on principal component analysis and optimal skew axis method (Promax).The results of item analysis showed that the total correlation coefficient of 10 items of the 48 items of the original DSI scale was lower than 0.3, and the total correlation coefficient of 6 items was not significant (r=-0.078-0.079, P>0.05), and the high and low groups were independent. There were significant differences in the results of the sample t test (t=-16.642-0.091, P<0.001), the 16 items were deleted, and the remaining 32 items; exploratory factor analysis showed that KMO=0.938>0.900, and the Bartlett's sphericity test result was significant (χ²=6 361.974, df=496, P<0.001), suitable for exploratory factor analysis, the results showed that 2 items constituted independent factors, did not meet the relevant standards of psychometrics and were deleted, and finally retained 30 items, and the internal consistency coefficient of the new scale was better than the original one(α=0.932>0.877); Based on the results of exploratory factor analysis, the model fitting indexes of 444 even-numbered samples such as RMSEA, SRMR, CFI and TLI were verified by confirmatory factor analysis, and the results showed that the index of each index was good (χ²=1 250.447, RMSEA=0.070, SRMR=0.068, CFI=0.839, TLI=0.823); criterion validity analysis found that each factor of the revised scale was significantly correlated with situational anxiety (r=0.190-0.556, P<0.01). In conclusion, the DSI (Chinese version) has good reliability and validity, and can be used as an assessment tool for driver stress in China.
China ; Factor Analysis, Statistical ; Humans ; Psychometrics ; Reproducibility of Results ; Surveys and Questionnaires

BACKGROUND: Pretesting is the key to understanding how the intended audience will react to the message. Resistant reactions affect message processing or can lead to undesirable boomerang effects. The objective of this study was to develop a rating scale for measuring active (reactance) and passive (disengagement) resistance to persuasive health messages. METHODS: Six candidate items (3 items for disengagement and 3 items for reactance) were generated based on literature review. A web-based survey was conducted among Japanese adults aged 25-64 years to verify the reliability and validity of the 6-item resistance scale. Participants were asked to rate one of the advance care planning (ACP) promotion messages. All scale items were scored on a 1-to-5 point Likert scale and they were averaged to produce the resistance score. RESULTS: Explanatory factor analysis revealed a two-factor solution that agreed with the disengagement and reactance domains, respectively. Correlation coefficients between each set of items ranged between 0.30-0.69. Cronbach alpha (0.86) indicated satisfactory internal consistency of the set of items. Confirmatory factor analysis showed a good fit of the two-factor model with CFI = 0.998, SRMR = 0.011, and RMSEA = 0.041. The resistance score showed a moderate positive correlation with negative emotional responses (displeasure γ = 0.55, anger γ = 0.53) and was significantly inversely related to the persuasiveness score (γ = -0.50). Multivariable logistic regression analysis showed that the odds ratio for ACP intention per 1-point increase in the resistance score was 0.47 (95% confidence interval 0.40-0.56) with adjustment for the persuasiveness score. CONCLUSION: The 6-item resistance scale exhibited adequate reliability and validity for measuring audience resistance when applied to the ACP promotion messages in Japanese people. The scale will be useful for pretesting health messages to make them more acceptable to the intended audience. TRIAL REGISTRATION Not applicable; this is not a report of intervention trial.
Adult ; Factor Analysis, Statistical ; Humans ; Intention ; Middle Aged ; Persuasive Communication ; Psychometrics ; Reproducibility of Results ; Surveys and Questionnaires

OBJECTIVES: Adolescents are at high risk of non-suicidal self-injury (NSSI). Currently, there is no clinical assessment tool for adolescent NSSI behaviors measurement with global consistency. The Ottawa Self-injury Inventory (OSI) is considered as a relatively comprehensive assessment tool for NSSI, but the questionnaire is discussed with excessive content and timecostly, which may affect the reliability of the measurement results for adolescent.Thus, this study, based on OSI, aims to revise the assessment tool for adolescent with NSSI that is suitable for both clinically and scientifically, referring to the diagnostic criteria for NSSI in the 5th Diagnostic and Statistical Manual of Mental Disorder (DSM-5). METHODS: This study was led by the Second Xiangya Hospital of Central South University and collaborated with 6 mental health service institutions in China from August to December 2020. Adolescent aged from 12 to 24 years old who had self-injury behavior and met the DSM-5 diagnostic criteria for NSSI were continuously recruited in the psychiatric outpatient department or ward. After clinical diagnosis by an experienced attending psychiatrist or above, the general information and OSI were collected by questionnaires. SPSS 24.0 and AMOS structural equation model statistical softwares were used to conduct item analysis and exploratory factor analysis on the obtained data to complete the revision of the scale. Cronbach's alpha coefficient, split-half reliability, test-retest reliability, and content validity and structure validity were performed to analyze the reliability and validity and confirmatory factor analysis was carried out to test the structure validity for the revised scale. RESULTS: A total of 234 adolescent with NSSI were enrolled, including 33 (14.1%) males and 201 (85.9%) females with the mean age of (16.2±2.6) years old. The most common clinical diagnoses were depression disorder (57.4%), bipolar disorder (20.9%), adolescent mood disorder (17.1%), etc. Nine items (item 2, 7, 11, 13, 23, 24, 10, 17, 18) in the functional scale of OSI were deleted according to extreme grouping method, correlation analysis, and principal component analysis in exploratory factor analysis. The revised functional scale for NSSI consisted of 15 items. The reliability analysis showed that the Cronbach's alpha coefficients of NSSI thought and behavior frequency, addiction characteristics, and function scales were 0.799, 0.798, and 0.835, respectively, and the split-half coefficients were 0.714, 0.727, and 0.852, respectively. The test-retest coefficients of the latter 2 scales were 0.466 and 0.560, respectively. The correlation coefficient between sub-items and total scores in each part of the scale showed good content validity. The exploratory factor analysis showed that a component was extracted from the frequency of thoughts and behaviors of NSSI, one component was extracted from the addictive characteristics, and three components were extracted from the functional part. The three functional subscales were social influence, external emotion regulation, and internal emotion regulation. The factor load of each item was >0.400. CONCLUSIONS The revised Chinese version OSI targeted the adolescent patients with mental disorders has relatively ideal reliability and validity. The scale shows high stability, dependability, and a reasonable degree of fit. It is a suitable assessment tool for clinical and scientific research on adolescent with NSSI.
Adolescent ; Adult ; Child ; Factor Analysis, Statistical ; Female ; Humans ; Male ; Mental Disorders/diagnosis* ; Psychometrics/methods* ; Reproducibility of Results ; Self-Injurious Behavior/psychology* ; Surveys and Questionnaires ; Young Adult