BACKGROUND

Due to the COVID-19 outbreak, schools had to switch online. The sudden transition to blended teaching and learning (BTL) poses challenges for students and teachers, especially for health science programs that require hands-on practical experience. The validity, reliability, and responsiveness of these self-report questionnaires (SRQs) should be established to ensure the accuracy of the results as intended by the SRQ.

This study critically appraised, compared, and summarized the psychometric properties of SRQ evaluating BTL among health science university students. This review determined the SRQ’s reliability, internal consistency, various forms of validity (content, criterion, construct), and responsiveness.

Following a 10-step procedure based on COSMIN guidelines, we conducted a systematic review of SRQs used by health science university students to evaluate blended teaching and learning. Studies were eligible if they reported psychometric properties of SRQs related to blended learning among university health science students; exclusions included studies focusing on perceptions, attitudes, self-efficacy, and satisfaction, as well as articles such as biographies, editorials, and conference materials. Searches covered multiple electronic databases until April 26, 2023, including PubMed, EMBASE, Web of Science, MEDLINE (OVID), PsycInfo, CINAHL, EBSCOHOST, ERIC, Scopus, Science Direct, Google Scholar, JSTOR, Acta Medica Philippina, Philippine Journal of Health Research and Development, and HERDIN, managed through Zotero. Two independent reviewers performed database searches, title and abstract screening, and full-text evaluations, with a third reviewer resolving any disputes. The COSMIN Risk of Bias Checklist was employed to evaluate included studies on the development and various measurement properties of SRQs. The reviewers assessed SRQ standards, including validity, reliability, internal consistency, measurement error, responsiveness, interpretability, and feasibility. Data extraction and result tabulation were independently completed, with content comparison by two health education experts. This evaluation categorized the SRQs into three quality and validity levels.

The study examined five articles; four were rated as 'doubtful' and one as 'inadequate' in the overall development of SRQ. All four 'doubtful' studies demonstrated questionable content validity when university students were asked about the questionnaire's relevance, comprehensiveness, and comprehensibility. Only half of these studies achieved an 'adequate' rating for content validity based on expert opinions on relevance and comprehensiveness. All but one study scored from 'very good' to 'adequate' in structural validity. Three out of the four studies scored a very good rating for internal consistency, while one was deemed 'inadequate' in internal consistency, cross-cultural validity, and reliability. Three out of four studies scored 'very good' on construct validity, but all overlooked criterion validity and responsiveness. Conducted in various locations, including Australia, Romania, Turkey, and Taiwan, these studies highlighted both common characteristics and limitations in questionnaire development according to the COSMIN guidelines. Four studies were deemed reliable and valid for BTL constructs (Category A); Wu et al. requires further validation (Category B). Study limitations included heterogeneity in populations, settings, and questionnaire versions, potential subjective bias in SRQ content comparison, and the evolving nature of SRQs in blended learning contexts.

The systematic review reports the development and evaluation of SRQs for BTL while identifying gaps in their applicability to health science programs. The Blended Learning Scale (BLS) of Lazar et al. and the Blended Learning Questionnaire (BLQ) of Ballouk et al. showed an ‘adequate' rating for content validity. BLS revealed very good structural validity, internal consistency, and adequate content validation. Although the BLQ lacked Confirmatory Factor Analysis, it yielded valuable constructs for evaluating health sciences students' experiences in BTL. Both tools require improvements on recall period, completion time, interpretability, and feasibility. The review underscores the necessity for cont inuous assessment and enhancement of such instruments in BTL, advocating a rigorous scale development process. Furthermore, it encourages the customization of teaching and learning evaluation tools to suit specific institutional contexts while promoting further validation of these questionnaires across different populations in future research.

BACKGROUND

Due to the COVID-19 outbreak, schools had to switch online. The sudden transition to blended teaching and learning (BTL) poses challenges for students and teachers, especially for health science programs that require hands-on practical experience. The validity, reliability, and responsiveness of these self-report questionnaires (SRQs) should be established to ensure the accuracy of the results as intended by the SRQ.

This study critically appraised, compared, and summarized the psychometric properties of SRQ evaluating BTL among health science university students. This review determined the SRQ’s reliability, internal consistency, various forms of validity (content, criterion, construct), and responsiveness.

Following a 10-step procedure based on COSMIN guidelines, we conducted a systematic review of SRQs used by health science university students to evaluate blended teaching and learning. Studies were eligible if they reported psychometric properties of SRQs related to blended learning among university health science students; exclusions included studies focusing on perceptions, attitudes, self-efficacy, and satisfaction, as well as articles such as biographies, editorials, and conference materials. Searches covered multiple electronic databases until April 26, 2023, including PubMed, EMBASE, Web of Science, MEDLINE (OVID), PsycInfo, CINAHL, EBSCOHOST, ERIC, Scopus, Science Direct, Google Scholar, JSTOR, Acta Medica Philippina, Philippine Journal of Health Research and Development, and HERDIN, managed through Zotero. Two independent reviewers performed database searches, title and abstract screening, and full-text evaluations, with a third reviewer resolving any disputes. The COSMIN Risk of Bias Checklist was employed to evaluate included studies on the development and various measurement properties of SRQs. The reviewers assessed SRQ standards, including validity, reliability, internal consistency, measurement error, responsiveness, interpretability, and feasibility. Data extraction and result tabulation were independently completed, with content comparison by two health education experts. This evaluation categorized the SRQs into three quality and validity levels.

The study examined five articles; four were rated as 'doubtful' and one as 'inadequate' in the overall development of SRQ. All four 'doubtful' studies demonstrated questionable content validity when university students were asked about the questionnaire's relevance, comprehensiveness, and comprehensibility. Only half of these studies achieved an 'adequate' rating for content validity based on expert opinions on relevance and comprehensiveness. All but one study scored from 'very good' to 'adequate' in structural validity. Three out of the four studies scored a very good rating for internal consistency, while one was deemed 'inadequate' in internal consistency, cross-cultural validity, and reliability. Three out of four studies scored 'very good' on construct validity, but all overlooked criterion validity and responsiveness. Conducted in various locations, including Australia, Romania, Turkey, and Taiwan, these studies highlighted both common characteristics and limitations in questionnaire development according to the COSMIN guidelines. Four studies were deemed reliable and valid for BTL constructs (Category A); Wu et al. requires further validation (Category B). Study limitations included heterogeneity in populations, settings, and questionnaire versions, potential subjective bias in SRQ content comparison, and the evolving nature of SRQs in blended learning contexts.

The systematic review reports the development and evaluation of SRQs for BTL while identifying gaps in their applicability to health science programs. The Blended Learning Scale (BLS) of Lazar et al. and the Blended Learning Questionnaire (BLQ) of Ballouk et al. showed an ‘adequate' rating for content validity. BLS revealed very good structural validity, internal consistency, and adequate content validation. Although the BLQ lacked Confirmatory Factor Analysis, it yielded valuable constructs for evaluating health sciences students' experiences in BTL. Both tools require improvements on recall period, completion time, interpretability, and feasibility. The review underscores the necessity for cont inuous assessment and enhancement of such instruments in BTL, advocating a rigorous scale development process. Furthermore, it encourages the customization of teaching and learning evaluation tools to suit specific institutional contexts while promoting further validation of these questionnaires across different populations in future research.

Background: There are various attitudes regarding their child's screen usage. However, there are no existing Filipino-translated and culturally appropriate questionnaires or assessment tools that can measure a child's media exposure, screen use, and parental attitude. The Media Exposure Survey is an assessment tool that measures a child’s media exposure, screen use, and parental attitudes regarding their child’s screen usage. Objectives: The study aims to contextualize and translate the questionnaire into Filipino, determine its content validity and internal consistency, and check the translated questionnaire's compatibility and applicability. Methods: The study involves four steps: 1) content validity testing, 2) forward and backward translation and equivalence, 3) pilot testing of the pre-final version, and 4) reliability resting. Data analysis was done to evaluate the content validity and internal consistency of the questionnaire. Thirty-six parents of children aged 0-5 in Metro Manila pilot tested the tool. Results: A cross-culturally adapted version of the Media Exposure Survey has been produced with good content validity. The S-CVI of the questionnaire is 95%, which is excellent. The parental attitude towards childhood media use subscale has an acceptable internal consistency with a Cronbach's alpha of 0.77. Conclusion The translated and adapted Media Exposure Survey has good content validity and acceptable internal consistency and can be used to assess Filipino children’s media exposure, screen use, and parental attitudes toward media use.
Surveys and Questionnaires ; Screen Time ; Psychometrics

BACKGROUND: Menopausal disorders include obscure symptomatology that greatly reduce work productivity among female workers. Quantifying the impact of menopause-related symptoms on work productivity is very difficult because no such guidelines exist to date. We aimed to develop a scale of overall health status for working women in the perimenopausal period. METHODS: In September, 2021, we conducted an Internet web survey which included 3,645 female workers aged 45-56 years in perimenopausal period. We asked the participants to answer 76 items relevant to menopausal symptomatology, that were created for this study and performed exploratory and confirmatory factor analyses for the scale development. Cronbach's alpha, receiver operating characteristic analysis, and logistic regression analysis were used to verify the developed scale. RESULTS: Approximately 85% participants did not have menstruation or disrupted cycles. Explanatory factor analysis using the maximum likelihood method and Promax rotation identified 21 items with a four-factor structure: psychological symptoms (8 items, α = 0.96); physiological symptoms (6 items, alpha = 0.87); sleep difficulty (4 items, alpha = 0.92); human relationship (3 items, alpha = 0.92). Confirmatory factor analyses found excellent model fit for the four-factor model (RMSR = 0.079; TLI = 0.929; CFI = 0.938). Criterion and concurrent validity were confirmed with high correlation coefficients between each of the four factors, previously validated menopausal symptom questionnaire, and Copenhagen Burnout Inventory scales, respectively (all ps < 0.0001). The developed scale was able to predict absenteeism with 78% sensitivity, 58% specificity, and an AUC of 0.727 (95%CI: 0.696-0.757). Higher scores of each factor as well as total score of the scale were more likely to be associated with work absence experience due to menopause-related symptoms even after adjusting for Copenhagen Burnout Inventory subscales (all ps < 0.0001). CONCLUSION We found that the developed scale has high validity and reliability and could be a significant indicator of absenteeism for working women in perimenopausal period.
Humans ; Female ; Perimenopause ; Reproducibility of Results ; Menopause/psychology* ; Workplace ; Surveys and Questionnaires ; Psychometrics

OBJECTIVE: To test the reliability and validity of the Chinese version of adverse childhood experiences international questionnaire (ACE-IQ) in Chinese parents of preschool children. METHODS: The parents of preschool children in 6 kindergartens in Tongzhou District of Beijing were selected by stratified random cluster sampling, and the Chinese version of ACE-IQ after translation and adaptation was used for survey online. The collected data were randomly divided into two parts. One part of the data (n=602) was used for exploratory factor analysis (EFA), to screen items and evaluate structural validity, and then form the final Chinese version of ACE-IQ. The other part of the data (n=700) was used for confirmatory factor analysis (CFA), criterion validity analysis and reliability analysis. At the same time, experts investigation method was used to evaluate the content validity of the final Chinese version of ACE-IQ. RESULTS: After deleting four items of collective violence, the Chinese version of ACE-IQ with twenty-five items indicated good structural, criterion and content validity. Analysis results showed that the Chinese version of ACE-IQ presented a seven-factor model dimension, namely emotional neglect, physical neglect, family dysfunction, family violence, emotional and physical abuse, sexual abuse and violence outside the home, and the total score of the binary version of ACE-IQ Chinese version was positively correlated with the total score of childhood trauma questionaire-28 item short form (CTQ-SF, r=0.354, P < 0.001) and the center for epidemiological studies depression scale (CES-D, r=0.313, P < 0.001) respectively. Results from five experts showed that the item-level content validity index (I-CVI) of 25 items was between 0.80 and 1.00, and the average of all I-CVIs on the scale (S-CVI/Ave) of the scale was 0.984. At the same time, the internal consistency (Cronbach's α coefficient) of the whole scale was 0.818, and the split-half reliability (Spearman-Brown coefficient) was 0.621, which demonstrated good reliability. CONCLUSION This study has formed a Chinese version of ACE-IQ with 25 items and 7 dimensions, which has good reliability and validity among the parents of preschool children in China. It can be used as an evaluation instrument for measuring the minimum threshold of the adverse childhood experiences in the parents of preschool children in the cultural background of China.
Humans ; Child, Preschool ; Adverse Childhood Experiences ; Reproducibility of Results ; Parents/psychology* ; Surveys and Questionnaires ; China ; Psychometrics/methods*

OBJECTIVES: The development and validation of the specific health literacy assessment tool for older adults is the basis for conducting the research on health literacy among older adults. The existing health literacy assessment scale for older adults in Chinese mainland has some limitations, such as too many items and poor compliance during the survey. It is necessary to develop or introduce simplified assessment tools to support large-scale surveys in the future. This study aims to modify the brief health literacy assessment scale compiled by Taiwan scholars, and to conduct the test for the reliability, validity and the measurement equivalence across gender in the older population in mainland China. METHODS: From March to April 2021, 508 older adults from Jinan, Shandong Province, China were selected by cluster sampling method to conduct a questionnaire survey using the brief health literacy assessment scale and health-promoting lifestyle profile. After 4 weeks, 83 of them were selected for retesting. SPSS 25.0 statistical software was used for descriptive analysis, item analysis, exploratory factor analysis, correlation analysis, and reliability test, and Mplus 8.0 was used for confirmatory factor analysis and gender measurement equivalence test. RESULTS: Each item of the scale had good discrimination, and there were significant differences in the scores of each item between high score and low score groups (P<0.05), and the coefficient of correlation between the scores of each item and the total score was between 0.721 and 0.891. Exploratory factor analysis extracted a factor with a characteristic root greater than 1, and the cumulative variance interpretation amount was 67.94%. The confirmatory factor analysis showed that the single factor structure fit was good [χ2/df was 2.260, the Tucker-Lewis index was 0.973, the comparison fit index (CFI) was 0.982, and the root mean square error of approximation (RMSEA) was 0.071]. The multi-group confirmatory factor analysis results showed that the brief health literacy assessment scale's configural equivalence, weak equivalence, and strong equivalence models were all accepted. The comparison results of measurement equivalence models showed that the changes of RMSEA were less than 0.015, and the changes of CFI were less than 0.01, indicating that the brief health literacy assessment scale had measurement equivalence between different gender groups. Cronbach's α coefficient was 0.945, and the test-retest reliability was 0.946. The correlation coefficient between health literacy and health-promotion lifestyles was 0.557 (P<0.05). CONCLUSIONS The brief health literacy assessment scale has good reliability, validity, and measurement equivalence across gender, and can be used as an effective measurement tool for the health literacy of the older people in Chinese mainland.
Humans ; Aged ; Reproducibility of Results ; Health Literacy/methods* ; Psychometrics ; Surveys and Questionnaires ; Asian People ; China ; Factor Analysis, Statistical

To develop a caregiver parenting behavior scale for children aged 2 to 6 years, and to verify its reliability and validity. This study recruited 1 350 caregivers of children aged 2 to 6 years. The item discrimination analysis and exploratory factor analysis were used to analyze the structure, dimensions and items of the scale. Homogeneity reliability, split-half reliability and test-retest reliability were used to analyze the reliability of the scale. Content validity and construct validity were used to analyze the validity of the scale. The results showed that the final scale contained 7 dimensions and 45 items. Cronbach's α coefficient of the total scale was 0.945; the coefficient of split half was 0.899; the test-retest reliability analysis showed that the correlation coefficients between the two tests were 0.893 (total score), 0.854 (social), 0.832 (language), 0.871 (gross motor), 0.893 (fine motor), 0.862 (cognitive), 0.832 (self-care), and 0.872 (sensory). The content validity analysis was carried out by two rounds of expert argumentation using Delphi expert consultation method. The Kendall coefficient of the items score in two rounds of Delphi expert consultation was 0.813 (P<0.01). The structure validity analysis showed that there were significant correlations between each dimension and the total scale, also between each dimension of the scale, and the extracted average variance values of each dimension was greater than the correlation coefficients between this dimension and other dimensions. In conclusion, the reliability and validity of the scale are qualified. It can be used as a tool to evaluate and guide the parenting behavior of caregivers of children aged 2 to 6 years.
Humans ; Child ; Caregivers/psychology* ; Reproducibility of Results ; Parenting ; Surveys and Questionnaires ; Factor Analysis, Statistical ; Psychometrics/methods*

OBJECTIVES: Patients from different social environments and cultural backgrounds have different nursing needs. If nurses ignore the cultural differences of patients, it is easy to lead to the strained nurse-patient relationship, affect the nursing effect and cause harm to patients. Critical cultural competence (CCC) can help nurses to meet the nursing needs of patients from different cultural backgrounds, which is beneficial to building a harmonious nurse-patient relationship and improving the quality of nursing. Almutairi, et al designed the Critical Cultural Competence Scale (CCCS) which can be used to evaluate accurately nurses' CCC. No studies have reported the development of a critical cultural competence measurement tool for nurses or the introduction of foreign scales in China. This study aims to conduct Chinese and cross-cultural debugging and test the reliability of the English version of the CCCS in order to form CCCS suitable for Chinese cultural background and provide an effective evaluation tool for investigating the current situation of clinical nurses' CCC. METHODS: This study used Brislin's back-translation model to translate and back-translation the English version of CCCS. The Chinese version of CCCS was then created through cross-cultural debugging by expert consultation and a pre-survey with a sample size of 30 clinical nurses. From August to October 2019, 580 clinical nurses were surveyed using a whole group sampling method. The participants were randomly divided into 2 groups with a 7꞉3 ratio. One group (n=406) was used for exploratory factor analysis and reliability analysis, while the other group (n=174) was used for confirmatory factor analysis. Six experts used the scale-level content validity index (S-CVI) and the item-level content validity index (I-CVI) to assess content validity. In the exploratory factor analysis, items were screened using the critical ratio method, and were tested using the KMO (Kalser-Meyer-Olkin) index, Bartlett's sphericity test, and principal component analysis. In the confirmatory factor analysis, average variance extracted (AVE), goodness of fit index (GFI), adjusted goodness of fit index (AGFI), and root mean square error of approximation (RMSEA) were used to assess the degree of fit of the constructed model. For the total scale and the 4 subscales, the Cronbach's α coefficient, split-half reliability, and retest reliability were used to assess the scale's reliability. RESULTS: The S-CVI was 0.930, while the I-CVI ranged from 0.833 to 0.944. For all items, the critical ratio exceeded 3, and the difference between the high and low subgroups was statistically significant (P<0.05). Exploratory factor analysis revealed critical knowledge subscale had a KMO value of 0.676, with the total scale and other 3 subscales all having a KMO value >0.8 and a chi-square value of 814.32 to 12 442.45 for the Bartlett's spherical test, with degree of freedom ranging from 21 to 136 (P<0.001), indicating that all items were suitable for factor analysis. The principal component analysis showed that 17, 12, 7, and 7 items were extracted from the 4 subscales, with 4, 3, 2, and 2 components whose eigenvalues were more than 1, and the cumulative variance contribution was 66.0%, 54.3%, 56.6%, and 70.2%, respectively. The confirmatory factor analysis showed that the AVE of the 4 subscales were 0.637, 0.499, 0.560, and 0.565, GFI was 0.904, AGFI was 0.863, and RMSEA was 0.076. The Cronbach's α coefficient for the total scale and subscales ranged from 0.811 to 0.878, the split-half reliability ranged from 0.707 to 0.842, and the retest reliability was 0.827. CONCLUSIONS The Chinese version of the CCCS has good reliability and validity, and it can be used as a valid assessment tool for clinical nurses' critical cultural competence in China.
Humans ; Cultural Competency ; Reproducibility of Results ; Psychometrics/methods* ; Factor Analysis, Statistical ; China

Objective: To evaluate the reliability and validity of the Chinese Criteria of Health Scale for the elderly people. Methods: A cross-sectional study was performed among older adults of Meiyuan Community in Haidian District, Beijing and Nanwangkong Village in Qingzhou City,Shandong Province during July 2021. Using a cluster sampling method, totally 667 elderly people were investigated by face-to-face interview, using the scale which was formulated after two rounds of the Delphi method and pilot study. The overall scale includes physical health, mental health and social health subscales, including 9, 52 and 15 items, respectively. Four weeks after the survey, 56 elderly people were randomly selected and repeated the survey with the same method. The test-retest reliability, split-half reliability and internal consistency reliability of the scale were evaluated, and the validity was evaluated at the same time, including construct validity and content validity. Results: A total of 710 questionnaires were distributed and 667 valid questionnaires were obtained, with a total effective rate of 93.94%. The score of the overall scale was 79.79±16.22, the scores of the physical health, mental health, social health sub-scores were 41.64±9.76, 26.82±3.92 and 11.34±5.19, respectively. The scale had excellent reliability. In the test-retest reliability, the intraclass correlation coefficient (ICC) of the overall scale and each subscale were 0.766-0.861, and the weighted Kappa values were 0.762-0.817. The Spearman-Brown coefficient of the overall scale and each subscale in the split-half reliability were 0.722-0.855 (all P<0.001). The Cronbach's α coefficients of the overall scale of internal consistency reliability and each subscale were 0.748-0.899, and the Cronbach's α coefficients of each dimension were from 0.709 to 0.963(all P<0.001). At the same time, the scale had good construct validity and content validity. The correlation coefficients between the score of each dimension and its sub-scale were larger, from 0.641 to 0.873 (all P<0.05). The cumulative variance contribution rates of the scale and three subscales were all more than 50% of the approved standard. A total of 11 common factors were extracted, and all the load values of each item on the corresponding factors were ≥0.04. Conclusion: The Chinese Criteria of Health Scale for the elderly people has good validity and excellent reliability. It can be used as a basis for the scientific division of the health status of the elderly, the formulation of relevant policies by the government and the provision of appropriate health services for the elderly.
Humans ; Aged ; Reproducibility of Results ; Cross-Sectional Studies ; Pilot Projects ; East Asian People ; Surveys and Questionnaires ; Psychometrics/methods* ; China

Objective: To translate the English version of the non-alcoholic fatty liver disease quality of life scale (CLDQ-NAFLD) into the Chinese version in order to test its reliability and validity. Methods: The English version of the CLDQ-NAFLD was translated according to the cross-cultural research tool debugging and validation guidelines to form the Chinese version of the CLDQ-NAFLD. A questionnaire survey was conducted on 515 NAFLD cases in a tertiary hospital in Hangzhou from September 2021 to April 2022 to evaluate the reliability and validity of the scale. Results: The Chinese version of the CLDQ-NAFLD contained six domains with a total of thirty-six items (X2/DF=3.105, RMSEA=0.064, TLI=0.905, CFI=0.912, and IFI=0.913). I-CVI, S-CVI/UA, and S-CVI/Ave was 0.83 to 1.00, 0.86 and 0.98, respectively. The 12-item Short-Form Health Survey (SF-12) was used as the calibration standard, and the correlation validity of the calibration standard was 0.704 (P<0.001). The Cronbach's alpha coefficient of the total scale and each dimension of the scale was 0.964 and 0.807-0.956, respectively. The test-retest reliability was 0.839. Conclusion: The Chinese version of the CLDQ-NAFLD has good reliability and validity. Thus, it can be used to evaluate the quality of life for NAFLD patients with a Chinese cultural background.
Humans ; Reproducibility of Results ; Quality of Life ; Non-alcoholic Fatty Liver Disease ; Surveys and Questionnaires ; Asian People ; China ; Psychometrics