16
views
0
recommends
+1 Recommend
1 collections
    0
    shares

      To submit to the journal, please click here

      We invite news and articles concerning all aspects of academic and professional publishing. Papers are welcomed from across the scholarly publishing community.

      • Record: found
      • Abstract: found
      • Article: found

      Evaluation of untrustworthy journals: Transition from formal criteria to a complex view

      Read this article at

      ScienceOpenPublisher
      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Not all the journals included in credible indices meet the ethical rules of COPE, DOAJ, OASPA, and WAME, and there may also be trustworthy journals excluded from these indices, which means they cannot be used as whitelists for trustworthy journals. Equally, the many methods suggested to determine trustworthiness are not reliable because they include questionable criteria. The question arises whether valid criteria for identifying an untrustworthy journal can be determined and whether other assessment procedures are necessary. Since 2017, the Masaryk University Campus Library has been developing a suitable evaluation method for journals. A list of 19 criteria based on those originally suggested by Beall, COPE, DOAJ, OASPA, and WAME were reduced to 10 objectively verifiable criteria following two workshops with librarians. An evaluation of 259 biomedical journals using both the list of 19 and then 10 criteria revealed that 74 journals may have been incorrectly assessed as untrustworthy using the longer list. The most common reason for failure to comply was in the provision of sufficient editorial information and declaration of article processing charges. However, our investigation revealed that no criteria can reliably identify predatory journals. Therefore, a complex evaluation is needed combining objectively verifiable criteria with analysis of a journal's content and knowledge of the journal's background.

          Related collections

          Most cited references70

          • Record: found
          • Abstract: not found
          • Article: not found

          The journal coverage of Web of Science and Scopus: a comparative analysis

            Bookmark
            • Record: found
            • Abstract: found
            • Article: found
            Is Open Access

            Self-Selected or Mandated, Open Access Increases Citation Impact for Higher Quality Research

            Background Articles whose authors have supplemented subscription-based access to the publisher's version by self-archiving their own final draft to make it accessible free for all on the web (“Open Access”, OA) are cited significantly more than articles in the same journal and year that have not been made OA. Some have suggested that this “OA Advantage” may not be causal but just a self-selection bias, because authors preferentially make higher-quality articles OA. To test this we compared self-selective self-archiving with mandatory self-archiving for a sample of 27,197 articles published 2002–2006 in 1,984 journals. Methdology/Principal Findings The OA Advantage proved just as high for both. Logistic regression analysis showed that the advantage is independent of other correlates of citations (article age; journal impact factor; number of co-authors, references or pages; field; article type; or country) and highest for the most highly cited articles. The OA Advantage is real, independent and causal, but skewed. Its size is indeed correlated with quality, just as citations themselves are (the top 20% of articles receive about 80% of all citations). Conclusions/Significance The OA advantage is greater for the more citable articles, not because of a quality bias from authors self-selecting what to make OA, but because of a quality advantage, from users self-selecting what to use and cite, freed by OA from the constraints of selective accessibility to subscribers only. It is hoped that these findings will help motivate the adoption of OA self-archiving mandates by universities, research institutions and research funders.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: found
              Is Open Access

              Potential predatory and legitimate biomedical journals: can you tell the difference? A cross-sectional comparison

              Background The Internet has transformed scholarly publishing, most notably, by the introduction of open access publishing. Recently, there has been a rise of online journals characterized as ‘predatory’, which actively solicit manuscripts and charge publications fees without providing robust peer review and editorial services. We carried out a cross-sectional comparison of characteristics of potential predatory, legitimate open access, and legitimate subscription-based biomedical journals. Methods On July 10, 2014, scholarly journals from each of the following groups were identified – potential predatory journals (source: Beall’s List), presumed legitimate, fully open access journals (source: PubMed Central), and presumed legitimate subscription-based (including hybrid) journals (source: Abridged Index Medicus). MEDLINE journal inclusion criteria were used to screen and identify biomedical journals from within the potential predatory journals group. One hundred journals from each group were randomly selected. Journal characteristics (e.g., website integrity, look and feel, editors and staff, editorial/peer review process, instructions to authors, publication model, copyright and licensing, journal location, and contact) were collected by one assessor and verified by a second. Summary statistics were calculated. Results Ninety-three predatory journals, 99 open access, and 100 subscription-based journals were analyzed; exclusions were due to website unavailability. Many more predatory journals’ homepages contained spelling errors (61/93, 66%) and distorted or potentially unauthorized images (59/93, 63%) compared to open access journals (6/99, 6% and 5/99, 5%, respectively) and subscription-based journals (3/100, 3% and 1/100, 1%, respectively). Thirty-one (33%) predatory journals promoted a bogus impact metric – the Index Copernicus Value – versus three (3%) open access journals and no subscription-based journals. Nearly three quarters (n = 66, 73%) of predatory journals had editors or editorial board members whose affiliation with the journal was unverified versus two (2%) open access journals and one (1%) subscription-based journal in which this was the case. Predatory journals charge a considerably smaller publication fee (median $100 USD, IQR $63–$150) than open access journals ($1865 USD, IQR $800–$2205) and subscription-based hybrid journals ($3000 USD, IQR $2500–$3000). Conclusions We identified 13 evidence-based characteristics by which predatory journals may potentially be distinguished from presumed legitimate journals. These may be useful for authors who are assessing journals for possible submission or for others, such as universities evaluating candidates’ publications as part of the hiring process.
                Bookmark

                Author and article information

                Contributors
                (View ORCID Profile)
                (View ORCID Profile)
                (View ORCID Profile)
                (View ORCID Profile)
                Journal
                Learned Publishing
                Learned Publishing
                John Wiley & Sons, Ltd.
                0953-1513
                1741-4857
                July 2020
                April 10 2020
                July 2020
                : 33
                : 3
                : 308-322
                Affiliations
                [1 ]University Campus Library Masaryk University Brno Czech Republic
                [2 ]Faculty of Sports Studies Masaryk University Brno Czech Republic
                [3 ]Faculty of Medicine Masaryk University Brno Czech Republic
                Article
                10.1002/leap.1299
                988c1688-4a52-4521-9017-60147c13a0f0
                © 2020

                http://onlinelibrary.wiley.com/termsAndConditions#vor

                http://doi.wiley.com/10.1002/tdm_license_1.1

                History

                Assessment, Evaluation & Research methods,Intellectual property law,Information & Library science,Communication & Media studies
                evaluation criteria,untrustworthy journals,predatory journals

                Comments

                Comment on this article