1.The design and application of spider track on the research performance evaluation of Fuwai hospital
Yeding CAO ; Yang WANG ; Yanyan ZHAO ; Wei LI
Chinese Journal of Medical Science Research Management 2017;30(4):273-277,281
Objective The ‘Spider Track Map (Fuwai)’is an innovative tool for comprehensive evaluation of scientific research performance.It was developed jointly by the Science & Research de partment and Medical Research & Biometrics Center in Fuwai Hospital.This tool aims to evaluate the development of scientific performances in 3 consecutive years of targeted departments,which will be considered to assess the technological competitiveness of each department.Methods The key variables were the number of projects,funding,awards,publications and patents during the last three years.After standardization,the weighted sum of those variables was calculated.Then the ‘Spider Track Map (Fuwai) ’ could be generated and the evaluation conclusion would be obtained after stratification.Results The ‘Spider Track Map (Fuwai)’ method had been used to evaluate the scientific research performance in 2015.The excellent research departments had been successfully elected and rewarded.Conclusions Beside the excellent department election,the method can also identify different feature of performance including improved,retrogressive,high efficiency or no changes.This multidimensional tool provides the reference to administrators for scientific commendation and reward and also the guid ing and alerting for specific department.
2.Evaluation and examination of research work for sections of Fuwai Hospital
Yeding CAO ; Wei LI ; Yang WANG ; Zheng WANG ; Lei SONG ; Manlu ZHU
Chinese Journal of Medical Science Research Management 2010;23(2):103-106
The Scientific Research Management Department of Fu Wai Hospital appraises the output capacities of the research centers and research departments every year.To inspire the research passion,we set up the assessment criteria and threshold of specific minimum output.In this paper,we described the method how we set up the thread shod for " qualified" and " excellent".We tested this method and got satisfactory evaluation results.It was indicated that our system provides a reliable,simple,practical and easy program for the research manage departments to appraise the different sections of the research departments.
3.Application of "Fuwai Spider Track Map"to evaluate the scientific and technological influence and competitiveness of tertiary hospitals in China
Yeding CAO ; Yanyan ZHAO ; Dan LI ; Yan YAO
Chinese Journal of Medical Science Research Management 2018;31(6):416-424
Objective Fuwai Spider Track Map (FSTM) is a scientific performance appraisal system established by the scientific research department of Fuwai Hospital.This study aimed to apply FSTM to the ranking and evaluation of scientific and technological influence and competitiveness of tertiary hospitals in China,comparison also conducted with othertraditional systems.Methods Tertiary hospitals consecutively selected as the national top 100 tertiary hospitals for 4 years from 2014 to 2017,according to the scientific and technological influence ranking list published in the official website of the Institute of Medical Information of Chinese Academy of Medical Sciences,were included.Total score,number of hospital staff and beds of these hospitals,accessed from the official website,were taking into account as reference data.Re-evaluation and ranking using FSTM was performed to evaluate and rank the scientific and technological influence and competitiveness.Besides,comparison analysis with traditional methods was conducted to identify the differences and similarities,advantages and disadvantages.Results The total quantity index and the per capita index represent the total research productivity and effectiveness,in other words,scientific and technological influence and competitiveness,respectively.The FSTM may integrate both indexes and avoid the disadvantages of single dimension evaluation.Conclusions Unlike the static results of traditional system,as a 3-dimentional method,FSTM may not only perform comprehensive but also evaluation of type,stratification and classification.It makes the hospitals in same type more comparable and provides multiple references for decision makers bv offering guidance and reference for the evaluation objects.
4.Application and practice of informal organization team to help scientific research management
Xiaoyun WANG ; Dan LI ; Yeding CAO
Chinese Journal of Medical Science Research Management 2019;32(6):460-464
Objective The study aimed to explore and improve the function of informal organizations by analyzing the informal organizations in the establishment of scientific research management.Methods Several teams of informal organizations were established according to the practical demand during the management.A series of scientific research work,which was based on the character of each organization combing with the information-sharing platform were carried out.Results Using the information sharing platform as the media,the informal organizations play an irreplaceable role in the management of scientific research,providing excellent assistance to the clinical work and scientific research.Conclusions The informal organizations function as the effective complement to the formal organization teams with the enhancement of working efficiency and the improvement of scientific management team.It greatly helps the scientific research as a multiple-unit high speed train.
5.Practice and discussion on optimizing expenditure management of scientific research in hospital
Xiaoyun WANG ; Jingzhou CHEN ; Dan LI ; Fangchao LIU ; Yeding CAO
Chinese Journal of Medical Science Research Management 2020;33(6):452-455
Objective:Combined with the hospital's optimization of expenditure management measures, this paper discusses how to enable scientific research personnel with appropriate discretion right to use scientific research funds and further improve the efficiency of the use of scientific research funds under the background of the reform of Release, manage and service.Methods:Through the implementation of information management system, policy revision, reconstruction of the approval process of expenditure, integration of multi department management resources and other ways, the efficiency of expenditure has been improved.Results:After optimizing the management of expenditure, the management efficiency and the efficiency of scientific research personnel is improved, the burden of scientific research personnel is reduced, and the expected effect of expenditure management is achieved.Conclusions:The optimization of expenditure management can improve the efficiency of expenditure to some extent, but more reform is still needed to promote the development of scientific research.
6.Problems and suggestions in the process of hospital scientific research funds management informatization
Xiaoyun WANG ; Liang WEI ; Jingzhou CHEN ; Ziyu GAO ; Yeding CAO
Chinese Journal of Medical Science Research Management 2021;34(5):377-381
Objective:Combined with the development and application of the hospital's current scientific research fund management information system, this paper explores how to further improve the informatization of scientific research fund management.Methods:Through the analysis of the service condition of four information systems, this paper identifies and illustrates problems existed in the process of informatization of scientific research funds.Results:There are some problems in the information system of scientific research funds, such as the failure to realize the " full life cycle" informatization of scientific research funds management, the uneven quality of information system, and lack of top-level design of management team. Route-cause analysis is conducted.Conclusions:It is suggested that the top-level design of information management at the national level, the reform of internal control system in hospitals, the cultivation of inter-disciplinary talent, and the increase of publicity should be taken to improve the informatization management of scientific research funds and improve the efficiency of funds utilization.
7.Establishment and application of intelligent evaluation system for scientific research performance
Dan LI ; Songtao BAI ; Danqi CHU ; Xiaoyun WANG ; Yan YAO ; Yeding CAO
Chinese Journal of Medical Science Research Management 2019;32(5):376-380
Objective The study built a scientific performance assessing model by using information technology to construct an intelligent reviewing system,in order to provide intelligent and normalized evaluation services for scientific research performance.Methods A comprehensive and novel practical scientific performance reviewing system was established to provide objective evaluation of scientific output,which was based on accumulated experience in Fuwai Hospital and ample discussion by the experts of academic committee.Results Scientific performance assessment service,which carried out by the collaboration of scientific research management department and informational technology center,were including senior professional title self-assessing system,annual scientific research performance assessing system on both the department basis and individual basis.All the service received satisfactory effect making the assessing service from manual to intelligent.It helps the assessment result turn into openness,fairness and justice.The establishment of the intelligent scientific performance assessing system broaden the mind and provide the basis for the further scientific reward self-evaluation,scientific project application conditions filtering,technology professionals intelligent screening,supervising qualification self-evaluation and scientific project self-reviewing etc.Conclusions The establishment of scientific performance reviewing system effectively avoided the subjective influence,provided timely,highly efficient and accurate evaluating service and comparative analysis,enabling the assessment result much more objective and fair.It merits the promotional value.
8.Design and practice of hierarchy three-level index system for scientific research performance evaluation
Dan LI ; Xiaoyun WANG ; Yan YAO ; Yeding CAO ; Jingzhou CHEN
Chinese Journal of Medical Science Research Management 2020;33(1):18-23
Objective By using the approach of "hierarchy three-level index system",this study aims at achieving precise scientific research performance evaluation,improving the proportion of high-tech products,and complementing the accumulative effect of conventional evaluation system.Methods This study transforms the conventional "plat three-level index system" into ‘hierarchy three-level index system',which consists of three levels of indexes,namely the national level,provincial level and local level.Candidates are categorized into three echelons according to the criteria for inclusion.Candidates of each echelon are evaluated and ranked by three-level indexes.Fuwai hospital's scientific advanced departments and individuals were evaluated by these two methods mentioned above,and the results were compared.Results These two index system are basically the same regarding to the overall evaluation pattern.Hierarchy three-level index system better displays the‘ quality strategy',allowing units with greater proportion of high-tech products to stand out as well as reducing the accumulative effect of massive production of medium-and-low-end products.Conclusions "Hierarchy three-level index system" is the remedy for the deficiencies of the conventional "plat three-level index system",it improves the reliability and validity of technology evaluation.Therefore,the system will contribute to the selection of scientific brains and the establishment of technology innovation system.
9.Establishment and practice of the innovative science and technology evaluation and service system of Fuwai Hospital
Yeding CAO ; Dan LI ; Songtao BAI ; Yan YAO ; Ziyu GAO ; Danqi CHU ; Xiaoyun WANG ; Jingzhou CHEN ; Jing FAN
Chinese Journal of Medical Science Research Management 2021;34(1):18-26
Objective:By demonstrating the performance, experience and practical value of the original " science and technology evaluation" of Fuwai Hospital, it is expected to build the brand of " Fuwai innovative service for science and technology evaluation" and provide a wider social service.Methods:The four-in-one " science and technology evaluation and service system" , which is composed of " standardized local data-base" , " Fuwai Spider Net Map and Spider Track Map evaluation method" , " hierarchy three-level index system" , and " intellectual science and technology evaluation and service system" , is established for efficient evaluation of science and technology.Results:The " science and technology evaluation and service system" has run with benefit in Fuwai Hospital for years.With the multi-factor evaluating feature, it solves the drawbacks of traditional evaluating system, thus improving accuracy of evaluation and helping implementation of national policies.If the system is extended to other hospitals, it would advocate the feature and strength of Fuwai science and technology evaluation system as well as provide pluralistic reference and advice for decision-making departments.Conclusions:Science and technology evaluation is such a systemic work, with all issues of different levels along the whole evaluating process to be considered.Drawbacks exist in the traditional method which depends on a single final score.By the practice of Fuwai Hospital, the innovative " four in one" evaluation system has been validated to be more scientific.
10.Methodological Exploration for Global Cardiovascular Academic Performance Evaluation(CAPE)System
Lu YIN ; Xueyan ZHANG ; Yeding CAO ; Wei LI ; Yan YAO ; Zhiyuan BO ; Liang WEI ; Jun CAI ; Jingang YANG ; Shengshou HU
Chinese Circulation Journal 2024;39(1):3-16,中插1-中插4
Objectives:To establish a comprehensive system of Cardiovascular Academic Performance Evaluation(CAPE)and rank global TOP100 medical institutions in the fields of cardiovascular diseases(CVD). Methods:CVD-related terms were extracted from Medical Subject Headings(MeSH),Embase thesaurus(EMtrees)and International Classification of Diseases(ICD)by CVD-related professionals,as well as by librarians and information professionals.Terminology databases(named as Fuwai Subject Headings)were established,and nine sub-disciplines were proposed,including ischemic heart diseases,hypertension,vascular diseases,arrhythmia,pulmonary vascular diseases,heart failure,congenital heart diseases,cardiomyopathy,and valvular heart diseases.The mapping patterns of sub-discipline,cardiovascular terminology and entry terms were pre-defined.The CVD-related research literature published from January 1,2016 to December 31,2022 were retrieved from Web of Science,PubMed and Scopus.Based on this,metadata were fused and duplicates were excluded.Fuwai Subject Headings were searched and matched into four respects for each literature,including subject words,titles,keywords,and abstracts,which was used to generate an information table of"Position—CVD terminology—Frequency",and to calculate CVD correlation scores and sub-discipline scores.We standardized the names of medical institutions and scholars,and make a ranking system for CAPE based on original articles with strong cardiovascular correlation(correlation score≥4).When evaluating the science and technological performance for Chinese hospitals in cardiovascular diseases,National Natural Science Foundation Projects,authorized invention patents,prize achievements,research platforms,and registered data of drug clinical trials in Center for Drug Evaluation(CDE)were considered besides research papers. Results:During 2016 and 2022,1 545 103 CVD research literatures were found worldwide.After excluding meeting abstracts,books,biographies,news,videos,audio texts,retracted publications,and corrections,1 178 019 CVD research literatures were further evaluated.518 058 literatures were indexed as"strongly correlated to CVD"using Fuwai Subject Headings.Besides papers,other data sources were also collected,including 11 143 CVD-related Natural Science Foundation Projects,19 382 CVD-related effective authorized invention patents,103 CVD-related national prize achievements,24 CVD-related national research platforms,and 2 084 CDE registered data of CVD-related drug clinical trials.Research teams from nine sub-disciplines reviewed and validated research literature in respective fields,and classification rules of corresponding sub-disciplines were created and improved based on their opinions.Finally,eleven individual indexes were chosen to construct CAPE system for ranking global TOP100 medical institutions in overall CVD field and TOP30 in nine sub-disciplines.From 2016 to 2022,the number of cardiovascular disease research papers published by Chinese institutes has increased by 123.5%,with a total of approximately 76.8 thousands papers published(about 30 papers per day on average),ranked the second under the United States(approximately 114.1 thousands papers).However,the proportion of papers published by the Chinese Journal Citation Reports(JCR)and the Chinese Academy of Sciences only ranked eighth in the world.In the comprehensive academic performance of original cardiovascular research papers in global hospitals from 2020 to 2022,only two Chinese medical institutions ranked in the TOP20 as evaluated by CAPE system. Conclusions:Based on multi-source data from 2016 to 2022,CAPE initiated to establish a cardiovascular academic performance evaluation system.