78
views
1
recommends
+1 Recommend
1 collections
    4
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Assessing scientists for hiring, promotion, and tenure

      other

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Assessment of researchers is necessary for decisions of hiring, promotion, and tenure. A burgeoning number of scientific leaders believe the current system of faculty incentives and rewards is misaligned with the needs of society and disconnected from the evidence about the causes of the reproducibility crisis and suboptimal quality of the scientific publication record. To address this issue, particularly for the clinical and life sciences, we convened a 22-member expert panel workshop in Washington, DC, in January 2017. Twenty-two academic leaders, funders, and scientists participated in the meeting. As background for the meeting, we completed a selective literature review of 22 key documents critiquing the current incentive system. From each document, we extracted how the authors perceived the problems of assessing science and scientists, the unintended consequences of maintaining the status quo for assessing scientists, and details of their proposed solutions. The resulting table was used as a seed for participant discussion. This resulted in six principles for assessing scientists and associated research and policy implications. We hope the content of this paper will serve as a basis for establishing best practices and redesigning the current approaches to assessing scientists by the many players involved in that process.

          Related collections

          Most cited references45

          • Record: found
          • Abstract: not found
          • Article: not found

          The history and meaning of the journal impact factor.

            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Sharing Detailed Research Data Is Associated with Increased Citation Rate

            Background Sharing research data provides benefit to the general scientific community, but the benefit is less obvious for the investigator who makes his or her data available. Principal Findings We examined the citation history of 85 cancer microarray clinical trial publications with respect to the availability of their data. The 48% of trials with publicly available microarray data received 85% of the aggregate citations. Publicly available data was significantly (p = 0.006) associated with a 69% increase in citations, independently of journal impact factor, date of publication, and author country of origin using linear regression. Significance This correlation between publicly available data and increased literature impact may further motivate investigators to share their detailed research data.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: found
              Is Open Access

              Badges to Acknowledge Open Practices: A Simple, Low-Cost, Effective Method for Increasing Transparency

              Beginning January 2014, Psychological Science gave authors the opportunity to signal open data and materials if they qualified for badges that accompanied published articles. Before badges, less than 3% of Psychological Science articles reported open data. After badges, 23% reported open data, with an accelerating trend; 39% reported open data in the first half of 2015, an increase of more than an order of magnitude from baseline. There was no change over time in the low rates of data sharing among comparison journals. Moreover, reporting openness does not guarantee openness. When badges were earned, reportedly available data were more likely to be actually available, correct, usable, and complete than when badges were not earned. Open materials also increased to a weaker degree, and there was more variability among comparison journals. Badges are simple, effective signals to promote open practices and improve preservation of data and materials by using independent repositories.
                Bookmark

                Author and article information

                Journal
                PLoS Biol
                PLoS Biol
                plos
                plosbiol
                PLoS Biology
                Public Library of Science (San Francisco, CA USA )
                1544-9173
                1545-7885
                29 March 2018
                March 2018
                29 March 2018
                : 16
                : 3
                : e2004089
                Affiliations
                [1 ] Centre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canada
                [2 ] Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, California, United States of America
                [3 ] INSERM CIC-P 1414, Clinical Investigation Center, CHU Rennes, Rennes 1 University, Rennes, France
                [4 ] Department of Clinical Psychology and Psychotherapy, Babeş-Bolyai University, Cluj-Napoca, Romania
                [5 ] Executive Board, UMC Utrecht, Utrecht University, Utrecht, the Netherlands
                [6 ] Department of Medicine, Stanford University, Stanford, California, United States of America
                [7 ] Department of Health Research and Policy, Stanford University, Stanford, California, United States of America
                [8 ] Department of Biomedical Data Science, Stanford University, Stanford, California, United States of America
                [9 ] Department of Statistics, Stanford University, Stanford, California, United States of America
                Author notes

                The authors have declared that no competing interests exist.

                Author information
                http://orcid.org/0000-0003-2434-4206
                Article
                pbio.2004089
                10.1371/journal.pbio.2004089
                5892914
                29596415
                adabf213-fdb3-49d5-bd11-c363155ec2da
                © 2018 Moher et al

                This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

                History
                Page count
                Figures: 0, Tables: 2, Pages: 20
                Funding
                The authors received no specific funding for this work.
                Categories
                Perspective
                Science Policy
                Science and Technology Workforce
                Careers in Research
                Scientists
                People and Places
                Population Groupings
                Professions
                Scientists
                Research and Analysis Methods
                Research Assessment
                Research and Analysis Methods
                Research Assessment
                Bibliometrics
                Research and Analysis Methods
                Research Assessment
                Research Reporting Guidelines
                Research and Analysis Methods
                Research Assessment
                Research Monitoring
                Research and Analysis Methods
                Research Design
                Research and Analysis Methods
                Research Assessment
                Citation Analysis
                Research and Analysis Methods
                Scientific Publishing
                Custom metadata
                vor-update-to-uncorrected-proof
                2018-04-10

                Life sciences
                Life sciences

                Comments

                Comment on this article