1.Utilizing cognitive interview in the item refinement of the Blended Teaching Assessment Tool (BTAT) for health professions education
Maria Teresita B. Dalusong ; Glenda Sanggalang Ogerio ; Valentin C. Dones III ; Maria Elizabeth M. Grageda
Philippine Journal of Health Research and Development 2025;29(2):54-59
BACKGROUND
Ahigh-quality measurement tool is essential to accurately assess the innovative teaching strategies in health professions education. The Blended Teaching Assessment Tool (BTAT) aims to evaluate quality blended teaching or instructional delivery in Philippine health science programs. However, there is a lack of studies examining students' cognitive processes to support the validity of questionnaires.
METHODOLOGYCognitive interviewing (CI) was employed to determine whether students interpreted and responded to the items correctly. Content analysis was done using Tourangeau's Cognitive framework. Four CIs were conducted by an expert moderator and note-taker with a total of 8 health science students (2 groups with 3 members, and 2 one-on-one interview) for around 1 to 2 hours via Zoom following a retroactive approach with verbal and spontaneous probing, guided by a semi-structured interview questionnaire.
RESULTSVarious issues related to comprehension, retrieval, judgment, and response were identified, leading to significant revisions of the tool from 82 items across 8 dimensions to 53 items across 5 dimensions. The challenges included unfamiliar terminology, ambiguous phrasing, complex statements, inconsistencies and irrelevance to students' real-life experiences. These findings emphasize the importance of students' feedback in enhancing the validity and reliability of assessment tools.
CONCLUSIONThe Cognitive Interview identified crucial issues in comprehension, retrieval, judgment, and response, making it essential for developing the Blended Teaching Assessment Tool and ensuring valid responses on the quality of blended teaching and learning delivery.
Health Occupations ; Education ; Teaching
3.Analysis of the core knowledge level of chronic diseases in Chinese adults and related factors.
Kai Ming GUO ; Wen Lan DONG ; Jian Qun DONG ; Ying Ying JIANG ; Fan MAO ; Wei Wei ZHANG ; Mai Geng ZHOU ; Wei JIANG
Chinese Journal of Preventive Medicine 2023;57(4):550-556
Objective: To understand the core knowledge level and influencing factors of chronic disease prevention and control in Adults in China, and to provide a scientific basis for formulating chronic disease prevention and control measures. Methods: In this study, cross-sectional survey and quota sampling were used to recruit 173 819 permanent residents aged 18 and above from 302 counties of adult chronic diseases and nutrition surveillance in China to conduct an online questionnaire survey, including basic information and core knowledge of chronic diseases. The scores of the core knowledge of chronic disease prevention and control were described by median and interquartile range, the Wilcoxon rank sum test or the Kruskal Wallis test was used for the inter-group comparison, and the correlation factors of the total score were analyzed by the multilinear regression model. Results: A total of 172 808 participants were surveyed in 302 counties and districts, of which 42.60%(73 623) were male and 57.40%(99 185) were female; The proportion of respondents aged 18-44, 45-59, and 60 years old and above was 54.74% (94 594), 30.91% (53 423) and 14.35% (24 791), respectively. The total score of the core knowledge of chronic prevention and control in the total population was 66(13), and the scores of different characteristic groups were different, and the differences were statistically significant: the eastern region had the highest score at 67(11) (H=840.66, P<0.01), the urban 66(12) was higher than the rural 65(14) (Z=-31.35, P<0.01), and the male 66(14) was lower than female 66(12) (Z=-11.66, P<0.01), 18-24 years old 64(13) was lower than other age groups(H=115.80, P<0.01), and undergraduate degree and above had the highest score compared to other academic qualifications, with 68(9) points(H=2 547.25, P<0.01). Multivariate analysis showed that eastern (t=27.42, P<0.01), central (t=17.33, P<0.01), urban (t=5.69, P<0.01), female (t=17.81, P<0.01), high age (t=46.04, P<0.01) and high education (t=57.77, P<0.01) had higher scores of core knowledge of chronic disease prevention and control than other groups, the scores of core knowledge of chronic disease prevention and control of professional and technical personnel (t=8.63, P<0.01), state enterprises and institutions (t=38.67, P<0.01), agriculture, forestry, animal husbandry, fishery and water conservancy production (t=5.30, P<0.01), production, transportation and commercial personnel (t=24.87, P<0.01), and other workers (t=8.89, P<0.01) were higher than those of non-employed people. Conclusion: There are differences in the total scores of the core knowledge of chronic disease prevention and control in different characteristics of people in China, and in the future, health education on the prevention and treatment of chronic diseases should be strengthened for specific groups to improve the knowledge level of residents.
Female
;
Humans
;
Male
;
China/epidemiology*
;
Chronic Disease
;
Cross-Sectional Studies
;
East Asian People
;
Occupations
;
Surveys and Questionnaires
;
Health Knowledge, Attitudes, Practice
4.Challenges of distance education assessment in the health professions during the COVID-19 pandemic: A Philippine reflection in the rapid review of international context.
Carl Joseph ABLAO ; Dan Clarence DIAZ ; Joshua MACAPAGAL
Acta Medica Philippina 2022;56(8):49-57
Objective. Assessment in distance education provides a safe evaluation environment during the COVID-19 pandemic. The purpose of this study is to explore the extent of knowledge available regarding the challenges of assessment in distance education of health professions during the 2020-2021 COVID-19 pandemic and to discuss a reflection in the Philippine setting.
Method. We conducted a rapid review through an electronic search in PubMed, Scopus, CINAHL, ERIC, Web of Science, and PsycINFO databases.
Results. Out of 1,519 articles, 9 were included for analysis. Philippine reflection was provided through an unsystematic search of literature. Challenges in assessment included resources, learners' issues, technical issues of the learning management system, and methodological assessment issues. Distance education allowed instructors to safely continue delivery of instruction and assessment during the pandemic.
Conclusion. The Philippine setting is relatable to the current international context of the challenges of assessment in distance education in health professions.
Education, Distance ; Health Occupations
6.Views on Precision Medicine among Health Professionals in Korea: A Mixed Methods Study
Ha Na CHO ; Soo Yong SHIN ; Bin HWANGBO ; Yoon Jung CHANG ; Juhee CHO ; Sun Young KONG ; Kui Son CHOI ; Eun Sook LEE
Yonsei Medical Journal 2020;61(2):192-197
health professionals in Korea and to identify issues that need to be addressed before implementing precision medicine. Mixed methods research was applied. For qualitative research, a semi-structured focus group interview was conducted with six health professionals. For quantitative research, a self-reported survey was administered. A total of 542 health professionals participated in the survey, and 526 completed the entire questionnaire. Health professionals showed positive attitudes toward precision medicine. About 95–96% of respondents agreed that precision medicine will be effective in treatment and precise diagnosis, and 69.9% reported that they would participate as study subjects. Meanwhile, they expressed concerns regarding educating patients and health professionals in precision medicine and developing research and data sharing infrastructure. Also, they emphasized the importance of developing precision medicine in an equitable way. Despite varying levels of awareness of precision medicine, the health professionals expressed a willingness to engage in precision medicine research, and recommended that health professionals work closely with policymakers to design precision medicine in a way that can be effectively adopted. Health professionals showed had a positive, but cautious, attitude toward precision medicine. The results of this study suggest areas to be addressed before ushering in precision medicine in Korea.]]>
Diagnosis
;
Focus Groups
;
Health Occupations
;
Humans
;
Information Dissemination
;
Korea
;
Methods
;
Precision Medicine
;
Qualitative Research
;
Surveys and Questionnaires
7.Physical Activity Patterns and Their Associated Factors Measured by Global Physical Activity Questionnaire Survey among Korean
Kyungha MIN ; Yun Hwan OH ; Sun Woo KIM ; Ho Jun KIM ; Houbuem LEE ; Sung Ha LEE ; Sunyoung KIM ; Jeong Sang LEE ; Jong Seung KIM ; Bumjo OH
The Korean Journal of Sports Medicine 2020;38(1):1-11
Research on physical activity and health is actively being conducted. In the Korea National Health and Nutrition Examination Survey (KNHANES), the Global Physical Activity Questionnaire (GPAQ) was newly introduced in 2014. The purpose of this study was to investigate the levels of physical activity and related factors in Koreans who were assessed through the GPAQ by dividing the physical activity by occupation, leisure, and transport domain. This study used data from the KNHANES (2014–2016), the study population of which included 17,357 participants aged 12 to 80 years. We compared the differences in physical activity by sociodemographic factors, health-related factors, and psychological health-related factors. Moreover, we also compared the mean metabolic equivalent of task and daily sitting time according to physical activity domain by sex and age group. Finally, we investigated the sociodemographic factors, health-related factors, and psychological health-related factors that significantly affect the average physical activity per week. The various factors were found to differ in the frequency of physical activity levels. In addition, there was a difference in the amount of physical activity per occupation, leisure, and transport domain in each age group. Finally, age, sex, high-density lipoprotein cholesterol levels, arthritis, allergic rhinitis and sinusitis, sleeping time, and perceived health status significantly affected physical activity. The levels of physical activity significantly differed by sociodemographic factors, health-related factors, and psychological health-related factors. There was also a difference in the physical activity levels according to the age and sex per each domain of physical activity.
Arthritis
;
Cholesterol
;
Humans
;
Korea
;
Leisure Activities
;
Lipoproteins
;
Metabolic Equivalent
;
Motor Activity
;
Nutrition Surveys
;
Occupations
;
Physical Fitness
;
Public Health
;
Rhinitis, Allergic
;
Risk Factors
;
Sinusitis
;
Social Determinants of Health
;
Surveys and Questionnaires
8.Factors Affecting Self-efficacy of Cardiopulmonary Resuscitation(CPR) in Adults
Journal of Agricultural Medicine & Community Health 2019;44(3):124-137
OBJECTIVES: The purpose of this study was factors affecting self-efficacy of cardiopulmonary resuscitation (CPR) in adults. Therefore, the provide basic data for strategy development to improve the performance rate of bystander CPR. METHODS: The data were collected from 164,165 adults of the 2016 Korean Community Health Survey. The survey method was 1:1 interview with households, and the survey period was from August 16, 2016 to October 31, 2016. The survey variables were as follows: self-efficacy of CPR, awareness of CPR, training experience of CPR, demographic characteristics, medical characteristics, health promoting behaviors, and safety practices. RESULTS: The rate of self-efficacy of CPR in adults was 60.6%. Factors affecting self-efficacy of CPR were age, sex, residence, education level, occupation, marital status, any CPR training, CPR training within the last 2 years, CPR training with manikin within the last 2 years, emergency room visit within the last 1 year, physical activity status, drive a bicycle, seat belts on rear seat, seat belts when riding a bus were statistically significant. CONCLUSIONS: In conclusion, in order to improve the self-efficacy of CPR in adults, the recent experience rate of CPR education, the practice rate of health promotion behavior, and the practice rate of safety behavior should be improved. The government should expand the provision of education programs to improve the self-efficacy of CPR and actively prepare national-level public advertisements strategies.
Adult
;
Cardiopulmonary Resuscitation
;
Education
;
Emergency Service, Hospital
;
Family Characteristics
;
Health Promotion
;
Health Surveys
;
Humans
;
Manikins
;
Marital Status
;
Motor Activity
;
Occupations
;
Seat Belts
;
Surveys and Questionnaires
9.Development and validation of the Hocus Focus Magic Performance Evaluation Scale for health professions personnel in the United States
Kevin SPENCER ; Hon Keung YUEN ; Max DARWIN ; Gavin JENKINS ; Kimberly KIRKLIN
Journal of Educational Evaluation for Health Professions 2019;16(1):8-
PURPOSE: This study was conducted to describe the development and validation of the Hocus Focus Magic Performance Evaluation Scale (HFMPES), which is used to evaluate the competency of health professions personnel in delivering magic tricks as a therapeutic modality. METHODS: A 2-phase validation process was used. Phase I (content validation) involved 16 magician judges who independently rated the relevance of each of the 5 items in the HFMPES and established the veracity of its content. Phase II evaluated the psychometric properties of the HFMPES. This process involved 2 magicians using the HFMPES to independently evaluate 73 occupational therapy graduate students demonstrating 3 magic tricks. RESULTS: The HFMPES achieved an excellent scale-content validity index of 0.99. Exploratory factor analysis of the HFMPES scores revealed 1 distinct factor with alpha coefficients ≥0.8 across the 3 magic tricks. The construct validity of the HFMPES scores was further supported by evidence from a known-groups analysis, in which the Mann–Whitney U-test showed significant difference in HFMPES scores between participants with different levels of experience in delivering the 3 magic tricks. The inter-rater reliability coefficients were ≥0.75 across the 3 magic tricks, indicating that the competency of health professions personnel in delivering the 3 magic tricks could be evaluated precisely. CONCLUSION: Preliminary evidence supported the content and construct validity of the HFMPES, which was found to have good internal consistency and inter-rater reliability in evaluating health professions personnel's competency in delivering magic tricks.
Complementary Therapies
;
Health Occupations
;
Humans
;
Magic
;
Occupational Therapy
;
Psychometrics
;
Reproducibility of Results
;
United States
10.Attitudes toward rehabilitating inmates among occupational therapy students in the United States
Sarah Catherine TUCKER ; Hon Keung YUEN
Journal of Educational Evaluation for Health Professions 2019;16(1):6-
PURPOSE: This study was to examine occupational therapy (OT) students' attitudes toward rehabilitating inmates and validate an instrument used to measure their attitudes. METHODS: OT students (n=128) from one university in Alabama, United States, completed an online survey exploring their attitudes toward rehabilitating inmates, which was assessed using the Rehabilitation Orientation Scale (ROS), a 7-point scale. Dimensional structure, internal consistency reliability, construct validity, and relations to other variables of the ROS was evaluated using factor analyses, Cronbach's alpha, known-groups method, and univariable correlations, respectively. RESULTS: Unidimensionality of the ROS was confirmed with an alpha coefficient of 0.90. The mean ROS score of the respondents was 5.1; a score toward 7 indicated a more supportive attitude. About 60% of the respondents reported supportive attitudes (i.e., an ROS score ≥5). Respondents' ROS scores were significantly higher than those of the public and criminal justice professionals. Female students reported a more supportive attitude than males. Multiple regression analysis indicated that respondents' consideration of working in prison settings after graduation and their perception that OT has a role in prison settings were significantly associated with support for rehabilitating inmates, after controlling for gender and an acquaintance with someone who has been incarcerated. CONCLUSION: Results indicated that the ROS demonstrated adequate psychometric properties as it applied to this population. The majority of respondents reported supportive attitudes toward rehabilitating inmates. Consideration of working in prison settings after graduation and the perception that OT has a role in prison settings were 2 independent factors associated with respondents' attitudes toward rehabilitating inmates.
Alabama
;
Attitude of Health Personnel
;
Criminal Law
;
Criminals
;
Female
;
Health Occupations
;
Humans
;
Male
;
Methods
;
Occupational Therapy
;
Prisons
;
Psychometrics
;
Rehabilitation
;
Surveys and Questionnaires
;
United States


Result Analysis
Print
Save
E-mail