111
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Evaluation of the Endorsement of the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) Statement on the Quality of Published Systematic Review and Meta-Analyses

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Introduction

          PRISMA statement was published in 2009 in order to set standards in the reporting of systematic reviews and meta-analyses. Our aim was to evaluate the impact of PRISMA endorsement on the quality of reporting and methodological quality of systematic reviews and meta-analyses, published in journals in the field of gastroenterology and hepatology (GH).

          Methods

          Quality of reporting and methodological quality were evaluated by assessing the adherence of papers to PRISMA checklist and AMSTAR quality scale. After identifying the GH journals which endorsed PRISMA in instructions for authors (IA), we appraised: 15 papers published in 2012 explicitly mentioning PRISMA in the full text (Group A); 15 papers from the same journals published in 2012 not explicitly mentioning PRISMA in the full text (Group B); 30 papers published the year preceding PRISMA endorsement from the same journals as above (Group C); 30 papers published in 2012 on the 10 highest impact factor journals in GH which not endorsed PRISMA (Group D).

          Results

          PRISMA statement was referred in the IA in 9 out of 70 GH journals (12.9%). We found significant increase in overall adherence to PRISMA checklist (Group A, 90.1%; Group C, 83.1%; p = 0.003) and compliance to AMSTAR scale (Group A, 85.0%; Group C, 74.6%; p = 0.002), following the PRISMA endorsement from the nine GH journals. Explicit referencing of PRISMA in manuscript was not associated with increase in quality of reporting and methodological quality (Group A vs. B, p = 0.651, p = 0.900, respectively). Adherence to PRISMA checklist, and the compliance with AMSTAR were significantly higher in journals endorsing PRISMA compared to those not (Groups A+B vs. D; p = 0.003 and p = 0.016, respectively).

          Conclusion

          The endorsement of PRISMA resulted in increase of both quality of reporting and methodological quality. It is advised that an increasing number of medical journals include PRISMA in the instructions for authors.

          Related collections

          Most cited references11

          • Record: found
          • Abstract: found
          • Article: not found

          Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Quality of Reporting of Meta-analyses.

          The Quality of Reporting of Meta-analyses (QUOROM) conference was convened to address standards for improving the quality of reporting of meta-analyses of clinical randomised controlled trials (RCTs). The QUOROM group consisted of 30 clinical epidemiologists, clinicians, statisticians, editors, and researchers. In conference, the group was asked to identify items they thought should be included in a checklist of standards. Whenever possible, checklist items were guided by research evidence suggesting that failure to adhere to the item proposed could lead to biased results. A modified Delphi technique was used in assessing candidate items. The conference resulted in the QUOROM statement, a checklist, and a flow diagram. The checklist describes our preferred way to present the abstract, introduction, methods, results, and discussion sections of a report of a meta-analysis. It is organised into 21 headings and subheadings regarding searches, selection, validity assessment, data abstraction, study characteristics, and quantitative data synthesis, and in the results with "trial flow", study characteristics, and quantitative data synthesis; research documentation was identified for eight of the 18 items. The flow diagram provides information about both the numbers of RCTs identified, included, and excluded and the reasons for exclusion of trials. We hope this report will generate further thought about ways to improve the quality of reports of meta-analyses of RCTs and that interested readers, reviewers, researchers, and editors will use the QUOROM statement and generate ideas for its improvement.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: found
            Is Open Access

            Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomised trial

            Objective To investigate the effect of an additional review based on reporting guidelines such as STROBE and CONSORT on quality of manuscripts. Design Masked randomised trial. Population Original research manuscripts submitted to the Medicina Clínica journal from May 2008 to April 2009 and considered suitable for publication. Intervention Control group: conventional peer reviews alone. Intervention group: conventional review plus an additional review looking for missing items from reporting guidelines. Outcomes Manuscript quality, assessed with a 5 point Likert scale (primary: overall quality; secondary: average quality of specific items in paper). Main analysis compared groups as allocated, after adjustment for baseline factors (analysis of covariance); sensitivity analysis compared groups as reviewed. Adherence to reviewer suggestions assessed with Likert scale. Results Of 126 consecutive papers receiving conventional review, 34 were not suitable for publication. The remaining 92 papers were allocated to receive conventional reviews alone (n=41) or additional reviews (n=51). Four papers assigned to the conventional review group deviated from protocol; they received an additional review based on reporting guidelines. We saw an improvement in manuscript quality in favour of the additional review group (comparison as allocated, 0.25, 95% confidence interval –0.05 to 0.54; as reviewed, 0.33, 0.03 to 0.63). More papers with additional reviews than with conventional reviews alone improved from baseline (22 (43%) v eight (20%), difference 23.6% (3.2% to 44.0%), number needed to treat 4.2 (from 2.3 to 31.2), relative risk 2.21 (1.10 to 4.44)). Authors in the additional review group adhered more to suggestions from conventional reviews than to those from additional reviews (average increase 0.43 Likert points (0.19 to 0.67)). Conclusions Additional reviews based on reporting guidelines improve manuscript quality, although the observed effect was smaller than hypothesised and not definitively demonstrated. Authors adhere more to suggestions from conventional reviews than to those from additional reviews, showing difficulties in adhering to high methodological standards at the latest research phases. To boost paper quality and impact, authors should be aware of future requirements of reporting guidelines at the very beginning of their study. Trial registration and protocol Although registries do not include trials of peer review, the protocol design was submitted to sponsored research projects (Instituto de Salud Carlos III, PI081903).
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Reporting in randomized clinical trials improved after adoption of the CONSORT statement.

              To examine the extent to which the Consolidated Standards of Reporting Trials (CONSORT) reporting guidelines improved clinical trials reporting and subject attrition, which may undermine the credibility of published randomized clinical trials (RCTs). Published RCTs reported in two major medical journals before and after the CONSORT guidelines were systematically reviewed; one used the CONSORT statement (JAMA) and one did not (NEJM). The quality of RCT reporting improved for both journals, but JAMA showed more significant and consistent improvements in all aspects of RCT reporting. Subject attrition was better accounted for after the publication of CONSORT, although the attrition rates for various reasons actually increased. Attrition due to unknown reasons, as a percentage of total attrition, declined dramatically, from 68.7% pre-CONSORT to 13.0% post-CONSORT. Attrition of study subjects remains a serious problem in RCTs. Bias from selective attrition can undermine the presumptive scientific advantage of RCTs. The CONSORT guidelines improved RCT reporting when they were implemented but did not substantially improve reported attrition rates.
                Bookmark

                Author and article information

                Contributors
                Role: Editor
                Journal
                PLoS One
                PLoS ONE
                plos
                plosone
                PLoS ONE
                Public Library of Science (San Francisco, USA )
                1932-6203
                2013
                26 December 2013
                : 8
                : 12
                : e83138
                Affiliations
                [1 ]Section of Hygiene, Institute of Public Health, Università Cattolica del Sacro Cuore, Rome, Italy
                [2 ]Faculty of Medicine, University of Belgrade, Belgrade, Serbia
                [3 ]University Clinical-Hospital Center “Dr Dragisa Misovic-Dedinje”, Belgrade, Serbia
                [4 ]IRCCS San Raffaele Pisana, Rome, Italy
                Brunel University, United Kingdom
                Author notes

                Competing Interests: The authors have declared that no competing interests exist.

                Conceived and designed the experiments: SB WR. Performed the experiments: NP SB GDB. Analyzed the data: EL. Wrote the paper: NP.

                Article
                PONE-D-13-18770
                10.1371/journal.pone.0083138
                3873291
                24386151
                40aa96cf-087d-433f-94a9-bd9af1abc8c6
                Copyright @ 2013

                This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

                History
                : 7 May 2013
                : 30 October 2013
                Page count
                Pages: 7
                Funding
                The work of Nikola Panic was supported by the ERAWEB project, funded with support of the European Community. The work of Dr Emanuele Leoncini was supported by Fondazione Veronesi. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
                Categories
                Research Article

                Uncategorized
                Uncategorized

                Comments

                Comment on this article