This paper summaries the Risk of Bias in Non-randomized Studies-of Environmental Exposure (ROBINS-E), a tool for evaluating risk of bias about non-randomized studies of exposures (NRSE), and introduces the application of ROBINS-E in a published NRSE. According to the characteristics of NRSE, evaluation fields and signaling questions were designed in ROBINS-E to provide essential information about risk of bias for NRSE included in systematic reviews and GRADE. ROBINS-E is the tool in assessment of risk of bias in observational studies and quasi-randomized studies. Although the tool has been used in practice to some extent, but it still needs further improvement. Attention should be paid to its update and progress.
Bias ; Environmental Exposure ; Humans ; Systematic Reviews as Topic

BACKGROUND: Functional constipation (FC) is one of the most prevalent functional gastrointestinal disorders. Dissatisfaction with medications prescribed to treat FC may lead patients to seek alternative treatments. Numerous systematic reviews (SRs) examining the use of acupuncture to treat FC have reported inconsistent results, and the quality of these studies has not been fully evaluated. OBJECTIVE: In this overview, we evaluated and summarized clinical evidence on the effectiveness and safety of acupuncture for treating FC and evaluated the quality and bias of the SRs we reviewed. SEARCH STRATEGY: The search strategy was structured by medical subject headings and search terms such as "acupuncture therapy" and "functional constipation." Electronic searches were conducted in eight databases from their inception to September 2020. INCLUSION CRITERIA: SRs that investigated the effectiveness and safety of acupuncture for managing FC were included. DATA EXTRACTION AND ANALYSIS: Two authors independently extracted information and appraised the methodology, reporting accuracy, quality of evidence, and risk of bias using the following critical appraisal tools: (1) A Measurement Tool to Assess Systematic Reviews 2 (AMSTAR 2); (2) Risk of Bias in Systematic Reviews (ROBIS); (3) Preferred Reporting Items for Systematic Reviews and Meta-analyses for Acupuncture (PRISMA-A); and (4) the Grading of Recommendations, Assessment, Development and Evaluations (GRADE). A κ index was used to score the level of agreement between the 2 reviewers. RESULTS: Thirteen SRs that examined the clinical utility of acupuncture for treating FC were identified. Using the AMSTAR 2 tool, we rated 92.3% (12/13) of the SRs as "critically low" confidence and one study as "low" confidence. Using the ROBIS criteria, 38.5% (5/13) of the SRs were considered to have "low risk" of bias. Based on PRISMA-A, 76.9% (10/13) of the SRs had over 70% compliance with reporting standards. The inter-rater agreement was good for AMSTAR 2, ROBIS, and PRISMA-A. Using the GRADE tool, we classified 22.5% (9/40) of the measured outcomes as "moderate" quality, 57.5% (23/40) as "low" quality, and 20.0% (8/40) as "very low" quality. The inter-rater agreement was moderate when using GRADE. Descriptive analyses indicated that acupuncture was more efficacious than sham acupuncture for improving weekly complete spontaneous bowel movements (CSBMs) and for raising the Bristol Stool Form Scale (BSFS) score. Acupuncture appeared to be superior to anti-constipation drugs for improving weekly spontaneous bowel movements, the total effective rate, and the Patient Assessment of Constipation Quality of Life score. Although ten SRs mentioned the occurrence of adverse events, serious adverse events were not associated with acupuncture treatment. CONCLUSION: Acupuncture may be more efficacious than sham acupuncture for improving CSBMs and BSFS scores and may be superior to anti-constipation drugs for improving bowel movement frequency, as well as quality of life. Limitations to current studies and inconsistent evidence suggest a need for more rigorous and methodologically sound SRs to draw definitive conclusions. SYSTEMATIC REVIEW REGISTRATION PROSPERO CRD42020189173.
Acupuncture Therapy ; Constipation/therapy* ; Humans ; Quality of Life ; Systematic Reviews as Topic

This paper introduces the Risk of Bias in Systematic Review (ROBIS), including: 1) the development of ROBIS, 2) three phases of ROBIS tool judging the overall risk of bias that related to systematic reviews, and 3) illustration on the application of ROBIS in a published systematic review. ROBIS is the first rigorously developed tool which is specifically designed to assess the risk of bias in systematic reviews. ROBIS will help improve the process of risk assessment on bias which appeared in overviews and guidelines.
Humans ; Bias ; Risk Assessment/methods* ; Systematic Reviews as Topic

Objective: To evaluate the methodology of the published systematic reviews and Meta-analyses (SR/MA) on efficacy and safety of coronavirus disease 2019 (COVID-19) vaccines. Methods: We conducted a retrieval for literatures published as of December 10, 2021 in English databases (Medline, Embase, Cochrane Library, Web of science) and Chinese databases (CNKI, Wanfang data, VIP, Sinomed). Two reviewers independently screened literatures and extracted data. The methodology of included SR/MA papers was assessed by A MeaSurement Tool to Assess systematic Review-2 (AMSTAR-2) tool in 16 items. Results: A total 22 SR/MA papers were included, in which 3 (13.6%) had low quality and 19 (86.4%) had very low quality. The main problems of these SR/MA included having no definite PICO (Participants, intervention, control and outcome), providing no preliminary research protocol, no list of excluded studies and justify the exclusions, making no evaluation and explanation or discussion of the risk of bias of original studies, no adequate evaluation of publication bias and discuss its likely impact on the results, etc. Conclusion: SR/MA for the efficacy and safety of COVID-19 vaccines had varied methodological deficiencies, further improvements are needed.
COVID-19/prevention & control* ; COVID-19 Vaccines/adverse effects* ; Humans ; Meta-Analysis as Topic ; Systematic Reviews as Topic

Anemia/epidemiology* ; Causality ; Dissent and Disputes ; Humans ; Meta-Analysis as Topic ; Risk Factors ; Systematic Reviews as Topic ; Tuberculosis/epidemiology*

Qingkailing Injection is one of the most commonly used traditional Chinese medicine injections with significant clinical application for the treatment of multiple diseases. This study aims to analyze the systematic reviews( SRs) of Qingkailing Injection,in order to provide reference for the clinical application of Qingkailing Injection and the development of relevant clinical practice guidelines. We searched CNKI,CBM,Wanfang,VIP,Pub Med,Cochrane Library and EMbase to collect SRs from the time of database establishment to August 2020. The eligible SRs were included according to the inclusion and exclusion criteria. AMSTAR 2 was used to assess the methodological quality. The diseases,drugs in combinations and results were extracted and analyzed. A total of 24 SRs were selected,including 10 for the treatment of acute cerebrovascular diseases,9 for respiratory infections,2 for viral hepatitis,1 for chronic obstructive pulmonary disease,and two for the adverse effects of Qingkailing Injection. Only three entries of AMSTAR 2 item were fully reported by over 70%,and the rest were reported by less than 70%,with no report about item 2,3 and 10. Twenty-nine outcome indicators were correlated with the included SRs,of which three mostly frequent outcomes were effectiveness,adverse reaction,and neurological deficit scores,showing a good efficacy of Qingkailing Injection. The common severe adverse reaction was anaphylaxis,and mild adverse reactions were skin and mucous membrane reactions. The most frequently combined drug was antibiotics,mainly Penicillin and Penicillin+Pioneeromycin. The existing evidences showed that the methodological quality of SRs of Qingkailing Injection needed to be improved and Qingkailing Injection had an obvious efficacy. However,the selection of outcome indicators for clinical trials and SRs shall be standardized,and the reporting of basic information,such as drug combination,shall be strengthened to provide more powerful clinical services.
Drugs, Chinese Herbal/adverse effects* ; Humans ; Injections ; Medicine, Chinese Traditional ; Systematic Reviews as Topic

This study aimed to analyze the methodological quality of systematic reviews of Shuxuening Injection and evaluate the efficacy and adverse reactions of Shuxuening Injection in the treatment of different diseases,in order to provide supportive evidence for clinical practice. Three Chinese databases and three English databases were retrieved to identify systematic reviews and Meta-analysis on the efficacy and safety of Shuxuening Injection in the treatment of diseases. The AMSTAR 2( a measurement tool to assess systematic reviews 2) tool was used to evaluate the methodological quality of the included systematic reviews,and tables were created to present the results of Meta-analyses. Twenty-four systematic reviews were included,all with very low methodological quality. Among the 16 AMSTAR-2 items,only 5 items had a compliance rate greater than 60. 0%,and 8 items had a compliance rate less than 50. 0%. For patients with cerebral infarction,Shuxuening Injection combined with conventional treatment was more effective than conventional treatment alone in terms of clinical efficiency and neurological deficit improvement. For patients with angina pectoris,Shuxuening Injection was superior to Danshen/Compound Danshen Injection in terms of the total effective rate of angina pectoris and total effective rate of ECG. The efficacy of Shuxuening Injection combined with conventional treatment is significantly better than conventional treatment.Shuxuening Injection( alone or combined with conventional treatments) was better than conventional treatments for cerebral hemorrhage,ischemic cerebrovascular disease,chronic pulmonary heart disease,vertigo and sudden deafness. Shuxuening Injection had better efficacy and lower incidence of adverse reactions,but the methodological quality of included systematic reviews was low. The results of this study still need to be verified by high-quality systematic reviews.
Angina Pectoris/drug therapy* ; Drugs, Chinese Herbal ; Humans ; Injections ; Salvia miltiorrhiza ; Systematic Reviews as Topic

To overview the systematic reviews of Panax notoginseng saponins in the treatment of acute cerebral infarction. CNKI, CBM, Wanfang, VIP, PubMed, Cochrane Library and EMbase databases were retrieved to collect the systematic reviews of the efficacy of P. notoginseng saponins in the treatment of acute cerebral infarction. The retrieval time was from the time of database establishment to January 2021. After two researchers independently screened out the literature and extracted the data, AMSTAR-2 scale was used to evaluate the methodological quality of the included systematic reviews, GRADE system was used to grade the quality of evidences of the outcome indicators, and the efficacy evaluation was summarized. A total of 5 systematic reviews were included. AMSTAR-2 evaluation results showed that 3 items were relatively complete, while 4 items had a poor overall quality. P. notoginseng saponins combined with conventional Western medicine therapy was superior to single conventional therapy in the recovery of neurological function, enhancement of the total effective rate in clinic, and improvement of activities of daily living. GRADE evaluation results showed that the quality of evidence was from low quality to very low quality. In conclusion, in the treatment of acute cerebral infarction, P. notoginseng saponins can improve the clinical efficacy, with a good safety but a not high methodological quality and a low evidence quality. It is suggested that high-quality clinical studies shall be further carried out to provide evidence-based basis for the application of P. notoginseng saponins in the treatment of acute cerebral infarction.
Activities of Daily Living ; Cerebral Infarction/drug therapy* ; Humans ; Panax notoginseng ; Saponins ; Systematic Reviews as Topic

There have been many clinical trials, systematic reviews/Meta-analysis proving that Xingnaojing Injection has a good clinical efficacy in treatment of cerebral ischaemic stroke, but with fewer comprehensive descriptions. In this study, an overview of systematic reviews/Meta-analysis of Xingnaojing Injection in treating cerebral ischaemic stroke was performed to provide current situation of evidences and basis for clinical practice. CNKI, Wanfang, VIP, CBM, EMbase, PubMed, Cochrane Library, Web of Science were retrieved through computers. A total of 6 literatures were included in this study. By AMSTAR-2 checklist and GRADE, the quality of included systematic reviews and the efficacy of Xingnaojing Injection were evaluated. The results of AMSTAR-2 checklist showed an extremely low quality for all of the 6 systematic reviews. According to the results of GRADE evaluation, among 55 outcomes, there were 2 outcomes with a medium quality, 4 outcomes with a low quality and 49 outcomes with an extremely low quality. The 6 systematic reviews reached a consistent conclusion that Xingnaojing Injection was effective in the treatment of cerebral ischaemic stroke. This therapy could improve the total efficacy, neurological deficit scores, hemodynamic and hemodynamic parameters. However, the methodolo-gical quality of all literatures was extremely low. The evidence levels of outcomes were between extremely low to medium. The effectiveness of Xingnaojing Injection in the treatment of cerebral ischaemic stroke still needs to be further verified by more high-quality studies. In the future, relevant clinical studies and systematic reviews/Meta-analysis shall be carried out in a strict accordance with relevant regulations.
Brain Ischemia/drug therapy* ; Drugs, Chinese Herbal ; Humans ; Ischemic Stroke ; Stroke/drug therapy* ; Systematic Reviews as Topic

To summarize and evaluate the efficacy and safety of Shenmai Injection in the treatment of viral myocarditis, shock, pulmonary heart disease, coronary heart disease, neutropenia and tumor chemotherapy, so as to provide supportive evidences for clinical rational use of Shenmai Injection. By searching literatures about studies on the systematic reviews on Shenmai Injection in treatment of viral myocarditis, shock, pulmonary heart disease, coronary heart disease, neutropenia and tumor chemotherapy from the main Chinese and English databases. Primary efficacy and safety outcome measures were selected for comparative analysis and summary, and the appraisal tool of AMSTAR 2 was used to evaluate the included studies.A total of 36 systematic reviews(published from 2005 to 2020) were included, involving viral myocarditis, shock, pulmonary heart disease, malignant tumor and coronary heart disease. The number of cases included in each type of the above diseases was 3 840, 2 484, 12 702, 28 036 and 27 082, respectively. The comparison results showed that, Shenmai Injection combined with conventional/western medicine treatment groups had better efficacy than conventional/western medicine groups alone in the prevention and treatment of the above five diseases. The main adverse reactions of Shenmai Injection reported in the included studies were facial flushing, rash, palpitation, etc., but the incidence was low and the general symptoms were mild, so no special treatment was needed. Therefore, the application of Shenmai Injection on the basis of conventional treatment or western medicine treatment had better prevention and treatment efficacy of the diseases. It was suggested that more multi-center and larger sample-size randomized controlled trials should be carried out in the future, and the relevant reporting standards should be strictly followed in systematic reviews, so as to improve the scientificity and transparency of the study.
Drug Combinations ; Drugs, Chinese Herbal ; Humans ; Pulmonary Heart Disease ; Systematic Reviews as Topic