1.Construction of the competency model for junior caregivers for the elderly based on the combination of medical and endowment model.
Li YANG ; Jinghui ZHANG ; Binbin XU ; Siyuan TANG ; Jianmei HOU ; Mengdan MA ; Zhengkun SHI
Journal of Central South University(Medical Sciences) 2018;43(6):679-684
To construct a competency model for junior caregivers for the elderly and to provide a reference for the selection, evaluation and training for the junior caregivers for the elderly.
Methods: Firstly, we drafted the primary competency model for junior caregivers for the elderly through literature review. Then, we used Delphi method to carry out 2 rounds of questionnaire survey for 20 experts to optimize the indicators for primary model. The weight of each indicator is determined by analytic hierarchy process (AHP) and expert sequencing method.
Results: The effective recovery rates of the two-round questionnaire were 87% and 100%, respectively. The expert authority coefficient was 0.70-0.93, and the average authority coefficient was 0.80. The final version of the competency model for junior caregivers for the elderly included 4 first-grade indexes, 11 second-grade indexes and 37 third-grade indexes.
Conclusion: The competency model for the junior caregivers for the elderly is reliable and can be used as the reference standard for the selection, evaluation and training for the junior caregivers for the elderly.
Aged
;
Caregivers
;
standards
;
Clinical Competence
;
Delphi Technique
;
Health Services for the Aged
;
standards
;
Humans
;
Medical Staff, Hospital
;
standards
;
Reference Standards
;
Surveys and Questionnaires
2.Comparison of three medical goggle sterilizing approaches.
Qun WANG ; Junjun MO ; Fang HUANG ; Ying PU ; Bei LYU
Journal of Zhejiang University. Medical sciences 2020;49(5):609-613
OBJECTIVE:
To compare three sterilizing methods for reusable medical goggles.
METHODS:
A total of 180 medical goggles of the same brand and same model were randomly divided into three groups. In group A the goggles were first soaked with 2000 mg/L chlorine-containing disinfectant and then cleaned manually; goggles in other two groups were sterilized using pre-programmed automatic spray cleaning and disinfection machine, the disinfection program was set to 90 ℃ for 5 min in group B and 70 ℃ for 30 min in group C. The quality of the sterilization was monitored by visual inspection with luminous magnifying glass and residual protein detection assay. User satisfaction on cleanliness of medical goggles, clarity of mirror surface and suitability of elastic bands was investigated with questionnaire survey.
RESULTS:
The qualification rates verified by visual inspection were 82.4%, 84.6%and 98.3%in group A, B and C, respectively, the qualification rate in group C was significantly higher than those in group B and group C (all
CONCLUSIONS
Machinery sterilization set 70 ℃ for 30 min has better cleaning and sterilizing effects for reusable medical goggles.
Eye Protective Devices/standards*
;
Sterilization/methods*
;
Surveys and Questionnaires
3.Content validity index in scale development.
Jingcheng SHI ; Xiankun MO ; Zhenqiu SUN
Journal of Central South University(Medical Sciences) 2012;37(2):152-155
Content validity is the degree to which an instrument has an appropriate sample of items for the construct being measured and is an important procedure in scale development. Content validity index (CVI) is the most widely used index in quantitative evaluation. There are 2 kinds of CVI: I-CVI and S-CVI. A method to compute a modified kappa statistic (K*) can be used to adjust I-CVI for chance agreement. S-CVI/UA and S-CVI/Ave are both scale level CVI with different formulas. Researchers recommend that a scale with excellent content validity should be composed of I-CVIs of 0.78 or higher and S-CVI/UA and S-CVI/Ave of 0.8 and 0.9 or higher, respectively. The characteristics and qualifications of the experts, process and main results of content validity evaluation should be reported in scale-related manuscript.
Data Collection
;
Humans
;
Psychometrics
;
methods
;
Reproducibility of Results
;
Surveys and Questionnaires
;
standards
4.A comprehensive evaluation of the health services in Hunan Province.
Gong GUO ; Qiong HE ; Zhenqiu SUN ; Yi BAI ; Linyong XU ; Min HU ; Yazhou XIAO ; Xiaohua ZHAO ; Fang ZENG ; Youzhe ZENG
Journal of Central South University(Medical Sciences) 2012;37(5):532-536
OBJECTIVE:
To establish a comprehensive evaluation system for the development of health services, and to assess the levels of health services in 2008 and 2009 in Hunan compared with seven other provinces in central China, so as to provide a basis for hygiene management decisions.
METHODS:
In order to establish a comprehensive evaluation system, a Delphi method, a boundary value method, and an RSR method were applied, respectively, to survey indices of health service development, to screen indices, and to determine index weights. A weighted TOPSIS method was used to evaluate the development status of health services of the eight provinces.
RESULTS:
The Cronbach's alpha coefficient of the questionnaire was 0.884, indicating a proper surface validity and a content validity. The expert positive coefficient, authority coefficient and Kendall coefficient were 93.75%, 0.8117, and 0.31, respectively. A comprehensive evaluation system, which consisted of 3 primary indices, 10 secondary indices and 52 tertiary indices, was established. The result of the comprehensive evaluation showed that the health services development of Hunan Province ranked 7th and 6th among the 8 central provinces for 2008 and 2009, respectively.
CONCLUSION
The established, comprehensive evaluation system has a high reliability. Health services development of Hunan Province is relatively backward among the 8 central provinces.
China
;
Health Services
;
standards
;
statistics & numerical data
;
Humans
;
Surveys and Questionnaires
5.Cutoff scores of the Ages and Stages Questionnaire-Chinese for screening infants and toddlers.
Guo-ying YAO ; Xiao-yan BIAN ; Jane SQUIRES ; Mei WEI ; Wei SONG
Chinese Journal of Pediatrics 2010;48(11):824-828
OBJECTIVETo study the validity and accuracy of differing cutoff scores of the Ages and Stages Questionnaires-Chinese (ASQ-C) for screening infants and toddlers in comparison with the gold standard, Bayley Scale of Infant Development, Second Edition (BSID II).
METHODThe 269 samples were enrolled from the normative children, aged 3 - 31 months, of the ASQ-C in Shanghai. The age-appropriate ASQ-Cs were completed by parents/caregivers and the BSIDIIwas administered by professionals. The cutoff scores of -2 standard deviation (s), -1.5 s, and -s for the ASQ-C were examined against BSID II with the cutoff scores set at -2 s as the standard of developmental delay, -s as the standard of suspected developmental delay and developmental delay respectively. Agreement between the classifications of the ASQ-C (i.e., typical, suspected, delay) was compared with the classification of the BSID II (typical, suspected, delay), sensitivity, specificity, Youden Index and area under ROC curve of ASQ-C were examined. The statistical analysis was carried out using SPSS 13.0.
RESULTWhen the cutoff score for BSID II was -2 s, the -2 s cutoff score for ASQ-C exhibited the following properties: the highest agreement of 83.64%, the sensitivity and specificity both above 80% being respectively 88.46% and 83.13%, the highest Youden Index of 0.72 and the largest area of 0.86 under ROC curve. The -1.5 s cutoff score for ASQ-C showed the following properties: 71.75% agreement, 100% sensitivity, 68.72% specificity, Youden Index = 0.69, the area under ROC curve = 0.84. The -s cutoff score for ASQ-C showed the following properties: the lowest agreement of 55.02%, 100% sensitivity, the lowest specificity of 50.21%, the lowest Youden Index of 0.50, and the smallest area of 0.75 under ROC curve. When the cutoff score for BSID II was set at -s, the -2 s for ASQ-C showed the following properties: the highest agreement of 85.87%, the lowest sensitivity of 68.57%, the highest specificity of 91.96%, Youden Index = 0.61, the smallest area = 0.77 under ROC curve. The -1.5 s for ASQ-C showed the following properties: the agreement of 80.67%, the sensitivity and specificity both above 70% being respectively 85.71% and 78.89%, the highest Youden Index of 0.65, the largest area of 0.82 under ROC. The -s cutoff score for ASQ-C showed the following properties: the lowest agreement of 68.40%, the highest sensitivity of 94.29%, the lowest specificity of 59.30%, the lowest Youden Index of 0.54, and the area under ROC curve = 0.80. When the cutoff score for BSID II was -1 to 2 s, the identifying percentages of the -2 s, -1.5 s and -s for the ASQ-C were 56.82%, 77.27% and 90.91%, respectively.
CONCLUSIONFor developmental delay identification, the -2 s cutoff score for ASQ-C produces the most robust validity and highest accuracy; for the identification of suspected developmental delay and developmental delay, the -1.5 s cutoff score for ASQ-C has the highest screening accuracy with appropriate sensitivity and specificity; for identifying the suspected developmental delay, the -s cutoff score for ASQ-C has the highest percentage of the identification. It is necessary to add 1 - 2 s to the ASQ-C's cutoff scores as the standard for screening suspected developmental delays.
Child Development ; Child, Preschool ; Humans ; Infant ; Mass Screening ; Reference Standards ; Sensitivity and Specificity ; Surveys and Questionnaires ; standards
6.Developing the criteria for evaluating quality of individualization in homeopathic clinical trial reporting: a preliminary study.
Subhranil SAHA ; E-mail: DRSUBHRANILSAHA@HOTMAIL.COM. ; Munmun KOLEY ; Subhasish GANGULY ; Prasanta RATH ; Pulak Roy CHOWDHURY ; Seikh Intaj HOSSAIN
Journal of Integrative Medicine 2014;12(1):13-19
OBJECTIVEThis study describes the development of a preliminary version of an instrument that attempts to assess the quality of reports of individualized homeopathic prescriptions in clinical trials and observational studies.
METHODSA multidisciplinary panel of 15 judges produced an initial version of the instrument through iterative Delphi rounds and pilot-tested the instrument on five clinical trials. Later they assessed, under blind conditions, the individualization quality of 40 randomly-selected research reports. The final version of the instrument included six criteria. These items were scored consistently by all the raters regardless of background.
RESULTSThe instrument appeared to have adequate face and content validity, acceptable internal consistency or reliability (Cronbach's α 0.606 - 0.725), significant discriminant validity (F = 398.7; P < 0.000 1), moderate interrater reliability (Fleiss κ 0.533), agreeable test-retest reliability (Cohen's κ 0.765 - 0.934), moderate sensitivity (0.4; 95% confidence interval 0.253-0.566), and high specificity (1.0; 95% confidence interval 0.891-1.000).
CONCLUSIONThe initial data suggest that this instrument may be a promising systematic tool amendable for further development.
Adult ; Evaluation Studies as Topic ; Female ; Homeopathy ; standards ; Humans ; Male ; Precision Medicine ; standards ; Quality Control ; Surveys and Questionnaires
7.A simple instrument for the assessment of student performance in problem-based learning tutorials.
Si-Mui SIM ; Nor Mohd Adnan AZILA ; Lay-Hoong LIAN ; Christina P L TAN ; Nget-Hong TAN
Annals of the Academy of Medicine, Singapore 2006;35(9):634-641
INTRODUCTIONA process-oriented instrument was developed for the summative assessment of student performance during problem-based learning (PBL) tutorials. This study evaluated (1) the acceptability of the instrument by tutors and (2) the consistency of assessment scores by different raters.
MATERIALS AND METHODSA survey of the tutors who had used the instrument was conducted to determine whether the assessment instrument or form was user-friendly. The 4 competencies assessed, using a 5-point rating scale, were (1) participation and communication skills, (2) cooperation or team-building skills, (3) comprehension or reasoning skills and (4) knowledge or information-gathering skills. Tutors were given a set of criteria guidelines for scoring the students' performance in these 4 competencies. Tutors were not attached to a particular PBL group, but took turns to facilitate different groups on different case or problem discussions. Assessment scores for one cohort of undergraduate medical students in their respective PBL groups in Year I (2003/2004) and Year II (2004/2005) were analysed. The consistency of scores was analysed using intraclass correlation.
RESULTSThe majority of the tutors surveyed expressed no difficulty in using the instrument and agreed that it helped them assess the students fairly. Analysis of the scores obtained for the above cohort indicated that the different raters were relatively consistent in their assessment of student performance, despite a small number consistently showing either "strict" or "indiscriminate" rating practice.
CONCLUSIONThe instrument designed for the assessment of student performance in the PBL tutorial classroom setting is user-friendly and is reliable when used judiciously with the criteria guidelines provided.
Education, Medical ; methods ; standards ; Educational Measurement ; methods ; Humans ; Problem-Based Learning ; standards ; Retrospective Studies ; Students, Medical ; Surveys and Questionnaires ; standards
8.Application of derivative Dolphe method in the constitution of practice guidelines on prevention and treatment of hypertension for primary care physicians.
Yang-feng WU ; Ning AN ; Xin WANG ; Lan SHAO
Acta Academiae Medicinae Sinicae 2002;24(6):577-581
OBJECTIVETo evaluate the necessity, scientificity, and feasibility of the drafted Practice Guidelines on Prevention and Treatment of Hypertension for Primary Care Physicians.
METHODSDerivative Dolphe Method was used to collect the responses from 50 experts in hypertension or related fields within the nation. An evaluation score of 1 to 5 was given to each item for selection, 1 for highly disagreed and 5 for highly agreed. The mean, standard deviation (SD) and coefficient of variance (CV) of the scores were calculated.
RESULTS(1) 90% experts responded to the evaluation sheet. (2) The mean score were above 4 for the five out of the six items related to necessity, the SD varied from 0.51 to 1.05, and the CV from 0.11 to 0.30. (3) Among the 28 items related to scientificity and rationality, the mean score was above 4 for 25 items and was between 3.5 and 4 for other three items. The CV was generally lower than 0.35. (4) Among the seven items related to feasibility, the mean score for five of them was lower than 4, and the CV varied from 0.21 to 0.33.
CONCLUSIONThe results indicate that the necessity and scientificity of the most content of the guidelines are confirmed by the invited experts.
Clinical Competence ; standards ; Humans ; Hypertension ; therapy ; Peer Review ; methods ; standards ; Physicians, Family ; Practice Guidelines as Topic ; standards ; Practice Patterns, Physicians' ; standards ; Reproducibility of Results ; Surveys and Questionnaires
9.Comparative assessment of students' performance and perceptions on objective structured practical models in undergraduate pathology teaching.
Than Than HTWE ; Sabaridah Binti ISMAIL ; Gary Kim Kuan LOW
Singapore medical journal 2014;55(9):502-505
INTRODUCTIONAssessment is an important factor that drives student learning, as students tend to mainly focus on the material to be assessed. The current practice in teaching pathology extensively applies objective-structured practical examination for the assessment of students. As students will have to deal with real patients during clinical years, it is preferred that students learn and practise via potted specimens and slides instead of picture plates. This study aimed to assess the preferred assesment method of pathology practical exercises.
METHODSThis was a cross-sectional survey carried out in two consecutive batches of Phase 2 medical students. Student competency was assessed using both the traditional (TD) (i.e. use of potted specimens and slides) and picture plate (PP) methods. To compare the two assessment methods, we compared the mean scores obtained by the students and examined student perception of the two methods.
RESULTSThe mean scores obtained via the PP method were significantly higher than those obtained via the TD method for almost all the components tested.
CONCLUSIONWe found that students performed significantly better (p < 0.05) when assessed using the PP method instead of the TD method. PP preparations might provide better visuals, thus aiding understanding, than the TD method. The findings of this study are valuable in identifying and improving our current teaching and assessment methods of medical students, in line with advancements in information technology.
Cross-Sectional Studies ; Education, Medical, Undergraduate ; methods ; standards ; Humans ; Pathology ; education ; standards ; Perception ; Reproducibility of Results ; Students ; Surveys and Questionnaires
10.Factors that influence student ratings of instruction.
Su Jin CHAE ; Yun Hoon CHOUNG ; Yoon Sok CHUNG
Korean Journal of Medical Education 2015;27(1):19-25
PURPOSE: The purpose of this study was to examine the validity of student ratings of instruction by analyzing their relationships with several variables, including gender, academic rank, specialty, teaching time, and teaching method, at a medical school. METHODS: This study analyzed the student ratings of 297 courses at Ajou University School of Medicine in 2013. SPSS version 12.0 was used to analyze the data and statistics by t-test, analysis of variance, and Scheffe test. RESULTS: There were no statistically significant differences in student ratings between gender, rank, and specialty. However, student ratings were significantly influenced by teaching times and methods (p<0.05). Student ratings were high for teaching times of 10 hours or more and small-group learning, compared with lectures. There was relatively mean differences in students ratings by teaching times, specialty and rank, although the difference in ratings was not statistically significant. CONCLUSION: Student ratings can be classified by teaching time and method for summative purposes. To apply student ratings to the evaluation of the performance of faculty, further studies are needed to analyze the variables that influence student ratings.
*Attitude
;
*Curriculum
;
*Education, Medical, Undergraduate
;
Faculty/standards
;
Female
;
Humans
;
*Learning
;
Male
;
*Schools, Medical
;
*Students, Medical
;
Surveys and Questionnaires
;
Teaching/*standards