1.Factors predicting rural location employment intent and choice among medical students and graduates
Charis GUILFOYLE ; Pin-Hsiang HUANG ; Lesley FORSTER ; Boaz SHULRUF
Korean Journal of Medical Education 2022;34(4):273-280
Purpose:
Workforce shortage is a contributing cause of health inequality in rural Australia. There is inconclusive evidence demonstrating which factors cause doctors to choose rural practice. This study’s objective is to determine predictive factors for medical students’ intent to work rurally and for graduates’ current rural employment location choice.
Methods:
This prospective cohort study, utilized data gathered from the University of New South Wales about students and graduates who had spent one or more years in a Rural Clinical School. Participants were final year students and graduates already working in Australia. Stepwise logistic regression was used to determine predictive factors for the two outcomes.
Results:
Predictors for student intent to work rurally are rural background (odds ratio [OR], 7.16; 95% confidence interval [CI], 2.59–19.53), choosing to study at the Rural Clinical School (OR, 8.72; 95% CI, 1.32–57.63), and perceiving rural areas as opportunistic for career advancement (OR, 1.69; 95% CI, 1.15–2.49). Predictors for graduates currently working in a rural location are Bonded Medical Program participation (OR, 6.40; 95% CI, 1.15–35.59) and personal altruism (OR, 1.91; 95% CI, 1.02–3.57).
Conclusion
While intent is predicted by having a rural background, choosing to study at the Rural Clinical School and perception of rural areas as having positive career opportunities, a current rural workplace location among graduates is predicted by holding a bonded medical position and a desire to serve an under-resourced population. Maintaining the Bonded Medical Program and clear communication regarding training pathways may increase numbers of rural doctors.
3.Medical student selection interviews: insights into nonverbal observable communications: a cross-sectional study
Pin-Hsiang HUANG ; Kang-Chen FAN ; Alexander WAITS ; Boaz SHULRUF ; Yi-Fang CHUANG
Korean Journal of Medical Education 2025;37(2):153-161
Purpose:
Interviews play a crucial role in the medical school selection process, although little is known about interviewers’ non-verbal observable communications (NoVOC) during the interviews. This study investigates how interviewers perceive NoVOC exhibited by interviewees in two medical schools, one in Taiwan and the other in Australia. The study also explores potential cross-cultural differences in these perceptions.
Methods:
A 26-item questionnaire was developed using a Delphi-like method to identify NoVOC. Interviewers from the University of New South Wales, Australia, and National Yang Ming Chiao Tung University, Taiwan (n=47 and N=78, respectively) rated these NoVOC between 2018 and 2021. Factor analyses identified and validated underlying factors. Measurement invariance across countries and genders was examined.
Results:
A total of 125 interviewers completed the questionnaire, including 78 from Taiwan and 47 from Australia. Using exploratory factor analysis, 14 items yielded reliable three factors “charming,” “disengaged,” and “anxious” (Cronbach’s α=0.853, 0.714, and 0.628, respectively). The measurement invariance analysis indicated that the factor models were invariant across genders but significantly different between the two countries. Further analysis revealed inconsistencies in interpreting the “anxious” factor between Taiwan and Australia.
Conclusion
The three distinct factors revealed in this study provide valuable insights into the NoVOC that interviewers perceive and evaluate during the interview process. The findings highlight the importance of considering non-verbal communication in selecting medical students and emphasize the need for training and awareness among interviewers. Understanding the impact of non-verbal behaviors can improve selection processes to mitigate bias and enhance the fairness and reliability of medical student selection.
5.Medical student selection interviews: insights into nonverbal observable communications: a cross-sectional study
Pin-Hsiang HUANG ; Kang-Chen FAN ; Alexander WAITS ; Boaz SHULRUF ; Yi-Fang CHUANG
Korean Journal of Medical Education 2025;37(2):153-161
Purpose:
Interviews play a crucial role in the medical school selection process, although little is known about interviewers’ non-verbal observable communications (NoVOC) during the interviews. This study investigates how interviewers perceive NoVOC exhibited by interviewees in two medical schools, one in Taiwan and the other in Australia. The study also explores potential cross-cultural differences in these perceptions.
Methods:
A 26-item questionnaire was developed using a Delphi-like method to identify NoVOC. Interviewers from the University of New South Wales, Australia, and National Yang Ming Chiao Tung University, Taiwan (n=47 and N=78, respectively) rated these NoVOC between 2018 and 2021. Factor analyses identified and validated underlying factors. Measurement invariance across countries and genders was examined.
Results:
A total of 125 interviewers completed the questionnaire, including 78 from Taiwan and 47 from Australia. Using exploratory factor analysis, 14 items yielded reliable three factors “charming,” “disengaged,” and “anxious” (Cronbach’s α=0.853, 0.714, and 0.628, respectively). The measurement invariance analysis indicated that the factor models were invariant across genders but significantly different between the two countries. Further analysis revealed inconsistencies in interpreting the “anxious” factor between Taiwan and Australia.
Conclusion
The three distinct factors revealed in this study provide valuable insights into the NoVOC that interviewers perceive and evaluate during the interview process. The findings highlight the importance of considering non-verbal communication in selecting medical students and emphasize the need for training and awareness among interviewers. Understanding the impact of non-verbal behaviors can improve selection processes to mitigate bias and enhance the fairness and reliability of medical student selection.
6.Insights into undergraduate medical student selection tools: a systematic review and meta-analysis
Pin-Hsiang HUANG ; Arash ARIANPOOR ; Silas TAYLOR ; Jenzel GONZALES ; Boaz SHULRUF
Journal of Educational Evaluation for Health Professions 2024;21(1):22-
Purpose:
Evaluating medical school selection tools is vital for evidence-based student selection. With previous reviews revealing knowledge gaps, this meta-analysis offers insights into the effectiveness of these selection tools.
Methods:
A systematic review and meta-analysis were conducted applying the following criteria: peer-reviewed articles available in English, published from 2010 and which include empirical data linking performance in selection tools with assessment and dropout outcomes of undergraduate entry medical programs. Systematic reviews, meta-analyses, general opinion pieces, or commentaries were excluded. Effect sizes (ESs) of the predictability of academic and clinical performance within and by the end of the medicine program were extracted, and the pooled ESs were presented.
Results:
Sixty-seven out of 2,212 articles were included, which yielded 236 ESs. Previous academic achievement predicted medical program academic performance (Cohen’s d=0.697 in early program; 0.619 in end of program) and clinical exams (0.545 in end of program). Within aptitude tests, verbal reasoning and quantitative reasoning predicted academic achievement in the early program and in the last years (0.704 & 0.643, respectively). Overall aptitude tests predicted academic achievement in both the early and last years (0.550 & 0.371, respectively). Neither panel interviews, multiple mini-interviews, nor situational judgement tests (SJT) yielded statistically significant pooled ES.
Conclusion
Current evidence suggests that learning outcomes are predicted by previous academic achievement and aptitude tests. The predictive value of SJT and topics such as selection algorithms, features of interview (e.g., content of the questions) and the way the interviewers’ reports are used, warrant further research.
7.Insights into undergraduate medical student selection tools: a systematic review and meta-analysis
Pin-Hsiang HUANG ; Arash ARIANPOOR ; Silas TAYLOR ; Jenzel GONZALES ; Boaz SHULRUF
Journal of Educational Evaluation for Health Professions 2024;21(1):22-
Purpose:
Evaluating medical school selection tools is vital for evidence-based student selection. With previous reviews revealing knowledge gaps, this meta-analysis offers insights into the effectiveness of these selection tools.
Methods:
A systematic review and meta-analysis were conducted applying the following criteria: peer-reviewed articles available in English, published from 2010 and which include empirical data linking performance in selection tools with assessment and dropout outcomes of undergraduate entry medical programs. Systematic reviews, meta-analyses, general opinion pieces, or commentaries were excluded. Effect sizes (ESs) of the predictability of academic and clinical performance within and by the end of the medicine program were extracted, and the pooled ESs were presented.
Results:
Sixty-seven out of 2,212 articles were included, which yielded 236 ESs. Previous academic achievement predicted medical program academic performance (Cohen’s d=0.697 in early program; 0.619 in end of program) and clinical exams (0.545 in end of program). Within aptitude tests, verbal reasoning and quantitative reasoning predicted academic achievement in the early program and in the last years (0.704 & 0.643, respectively). Overall aptitude tests predicted academic achievement in both the early and last years (0.550 & 0.371, respectively). Neither panel interviews, multiple mini-interviews, nor situational judgement tests (SJT) yielded statistically significant pooled ES.
Conclusion
Current evidence suggests that learning outcomes are predicted by previous academic achievement and aptitude tests. The predictive value of SJT and topics such as selection algorithms, features of interview (e.g., content of the questions) and the way the interviewers’ reports are used, warrant further research.
9.Medical student selection interviews: insights into nonverbal observable communications: a cross-sectional study
Pin-Hsiang HUANG ; Kang-Chen FAN ; Alexander WAITS ; Boaz SHULRUF ; Yi-Fang CHUANG
Korean Journal of Medical Education 2025;37(2):153-161
Purpose:
Interviews play a crucial role in the medical school selection process, although little is known about interviewers’ non-verbal observable communications (NoVOC) during the interviews. This study investigates how interviewers perceive NoVOC exhibited by interviewees in two medical schools, one in Taiwan and the other in Australia. The study also explores potential cross-cultural differences in these perceptions.
Methods:
A 26-item questionnaire was developed using a Delphi-like method to identify NoVOC. Interviewers from the University of New South Wales, Australia, and National Yang Ming Chiao Tung University, Taiwan (n=47 and N=78, respectively) rated these NoVOC between 2018 and 2021. Factor analyses identified and validated underlying factors. Measurement invariance across countries and genders was examined.
Results:
A total of 125 interviewers completed the questionnaire, including 78 from Taiwan and 47 from Australia. Using exploratory factor analysis, 14 items yielded reliable three factors “charming,” “disengaged,” and “anxious” (Cronbach’s α=0.853, 0.714, and 0.628, respectively). The measurement invariance analysis indicated that the factor models were invariant across genders but significantly different between the two countries. Further analysis revealed inconsistencies in interpreting the “anxious” factor between Taiwan and Australia.
Conclusion
The three distinct factors revealed in this study provide valuable insights into the NoVOC that interviewers perceive and evaluate during the interview process. The findings highlight the importance of considering non-verbal communication in selecting medical students and emphasize the need for training and awareness among interviewers. Understanding the impact of non-verbal behaviors can improve selection processes to mitigate bias and enhance the fairness and reliability of medical student selection.
10.Insights into undergraduate medical student selection tools: a systematic review and meta-analysis
Pin-Hsiang HUANG ; Arash ARIANPOOR ; Silas TAYLOR ; Jenzel GONZALES ; Boaz SHULRUF
Journal of Educational Evaluation for Health Professions 2024;21(1):22-
Purpose:
Evaluating medical school selection tools is vital for evidence-based student selection. With previous reviews revealing knowledge gaps, this meta-analysis offers insights into the effectiveness of these selection tools.
Methods:
A systematic review and meta-analysis were conducted applying the following criteria: peer-reviewed articles available in English, published from 2010 and which include empirical data linking performance in selection tools with assessment and dropout outcomes of undergraduate entry medical programs. Systematic reviews, meta-analyses, general opinion pieces, or commentaries were excluded. Effect sizes (ESs) of the predictability of academic and clinical performance within and by the end of the medicine program were extracted, and the pooled ESs were presented.
Results:
Sixty-seven out of 2,212 articles were included, which yielded 236 ESs. Previous academic achievement predicted medical program academic performance (Cohen’s d=0.697 in early program; 0.619 in end of program) and clinical exams (0.545 in end of program). Within aptitude tests, verbal reasoning and quantitative reasoning predicted academic achievement in the early program and in the last years (0.704 & 0.643, respectively). Overall aptitude tests predicted academic achievement in both the early and last years (0.550 & 0.371, respectively). Neither panel interviews, multiple mini-interviews, nor situational judgement tests (SJT) yielded statistically significant pooled ES.
Conclusion
Current evidence suggests that learning outcomes are predicted by previous academic achievement and aptitude tests. The predictive value of SJT and topics such as selection algorithms, features of interview (e.g., content of the questions) and the way the interviewers’ reports are used, warrant further research.