8
views
1
recommends
+1 Recommend
1 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Predatory publications in evidence syntheses

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Objectives

          The number of predatory journals is increasing in the scholarly communication realm. These journals use questionable business practices, minimal or no peer review, or limited editorial oversight and, thus, publish articles below a minimally accepted standard of quality. These publications have the potential to alter the results of knowledge syntheses. The objective of this study was to determine the degree to which articles published by a major predatory publisher in the health and biomedical sciences are cited in systematic reviews.

          Methods

          The authors downloaded citations of articles published by a known predatory publisher. Using forward reference searching in Google Scholar, we examined whether these publications were cited in systematic reviews.

          Results

          The selected predatory publisher published 459 journals in the health and biomedical sciences. Sixty-two of these journal titles had published a total of 120 articles that were cited by at least 1 systematic review, with a total of 157 systematic reviews citing an article from 1 of these predatory journals.

          Discussion

          Systematic review authors should be vigilant for predatory journals that can appear to be legitimate. To reduce the risk of including articles from predatory journals in knowledge syntheses, systematic reviewers should use a checklist to ensure a measure of quality control for included papers and be aware that Google Scholar and PubMed do not provide the same level of quality control as other bibliographic databases.

          Related collections

          Most cited references16

          • Record: found
          • Abstract: found
          • Article: not found

          A systematic review of the content of critical appraisal tools

          Background Consumers of research (researchers, administrators, educators and clinicians) frequently use standard critical appraisal tools to evaluate the quality of published research reports. However, there is no consensus regarding the most appropriate critical appraisal tool for allied health research. We summarized the content, intent, construction and psychometric properties of published, currently available critical appraisal tools to identify common elements and their relevance to allied health research. Methods A systematic review was undertaken of 121 published critical appraisal tools sourced from 108 papers located on electronic databases and the Internet. The tools were classified according to the study design for which they were intended. Their items were then classified into one of 12 criteria based on their intent. Commonly occurring items were identified. The empirical basis for construction of the tool, the method by which overall quality of the study was established, the psychometric properties of the critical appraisal tools and whether guidelines were provided for their use were also recorded. Results Eighty-seven percent of critical appraisal tools were specific to a research design, with most tools having been developed for experimental studies. There was considerable variability in items contained in the critical appraisal tools. Twelve percent of available tools were developed using specified empirical research. Forty-nine percent of the critical appraisal tools summarized the quality appraisal into a numeric summary score. Few critical appraisal tools had documented evidence of validity of their items, or reliability of use. Guidelines regarding administration of the tools were provided in 43% of cases. Conclusions There was considerable variability in intent, components, construction and psychometric properties of published critical appraisal tools for research reports. There is no "gold standard' critical appraisal tool for any study design, nor is there any widely accepted generic tool that can be applied equally well across study types. No tool was specific to allied health research requirements. Thus interpretation of critical appraisal of research reports currently needs to be considered in light of the properties and intent of the critical appraisal tool chosen for the task.
            Bookmark
            • Record: found
            • Abstract: not found
            • Article: not found

            Suitability of Google Scholar as a source of scientific information and as a source of data for scientific evaluation—Review of the Literature

              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Assessment of methodological quality of primary studies by systematic reviews: results of the metaquality cross sectional study.

              To describe how the methodological quality of primary studies is assessed in systematic reviews and whether the quality assessment is taken into account in the interpretation of results. Cochrane systematic reviews and systematic reviews in paper based journals. 965 systematic reviews (809 Cochrane reviews and 156 paper based reviews) published between 1995 and 2002. The methodological quality of primary studies was assessed in 854 of the 965 systematic reviews (88.5%). This occurred more often in Cochrane reviews than in paper based reviews (93.9% v 60.3%, P < 0.0001). Overall, only 496 (51.4%) used the quality assessment in the analysis and interpretation of the results or in their discussion, with no significant differences between Cochrane reviews and paper based reviews (52% v 49%, P = 0.58). The tools and methods used for quality assessment varied widely. Cochrane reviews fared better than systematic reviews published in paper based journals in terms of assessment of methodological quality of primary studies, although they both largely failed to take it into account in the interpretation of results. Methods for assessment of methodological quality by systematic reviews are still in their infancy and there is substantial room for improvement.
                Bookmark

                Author and article information

                Journal
                J Med Libr Assoc
                J Med Libr Assoc
                mlab
                Journal of the Medical Library Association : JMLA
                Medical Library Association (65 East Wacker Place, Suite 1900, Chicago, IL 60601-7246 )
                1536-5050
                1558-9439
                January 2019
                01 January 2019
                : 107
                : 1
                : 57-61
                Affiliations
                Associate Librarian, Bracken Health Sciences Library, Queen’s University, Kingston, ON, Canada, amanda.ross-white@ 123456queensu.ca
                Associate Professor, School of Nursing, Queen’s Joanna Briggs Collaboration, Queen’s University, Kingston, ON, Canada, christina.godfrey@ 123456queensu.ca
                Associate Professor and Associate Director (Healthcare Quality), School of Nursing, Queen’s University, Kingston, ON, Canada, kim.sears@ 123456queensu.ca
                Associate Professor, School of Nursing, Queen’s University, Kingston, ON, Canada, rosemary.wilson@ 123456queensu.ca
                Author information
                https://orcid.org/0000-0003-4737-0968
                https://orcid.org/0000-0003-3262-243X
                Article
                jmla-107-57
                10.5195/jmla.2019.491
                6300240
                30598649
                302fa405-5ee2-4364-aff0-949f90dafb55
                Copyright: © 2019, Authors.

                Articles in this journal are licensed under a Creative Commons Attribution 4.0 International License.

                History
                : 01 April 2018
                : 01 September 2018
                Categories
                Original Investigation

                Comments

                Comment on this article