320
views
1
recommends
+1 Recommend
0 collections
    32
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      An open investigation of the reproducibility of cancer biology research

      research-article

      Read this article at

          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          It is widely believed that research that builds upon previously published findings has reproduced the original work. However, it is rare for researchers to perform or publish direct replications of existing results. The Reproducibility Project: Cancer Biology is an open investigation of reproducibility in preclinical cancer biology research. We have identified 50 high impact cancer biology articles published in the period 2010-2012, and plan to replicate a subset of experimental results from each article. A Registered Report detailing the proposed experimental designs and protocols for each subset of experiments will be peer reviewed and published prior to data collection. The results of these experiments will then be published in a Replication Study. The resulting open methodology and dataset will provide evidence about the reproducibility of high-impact results, and an opportunity to identify predictors of reproducibility.

          DOI: http://dx.doi.org/10.7554/eLife.04333.001

          Related collections

          Most cited references27

          • Record: found
          • Abstract: found
          • Article: not found

          A call for transparent reporting to optimize the predictive value of preclinical research.

          The US National Institute of Neurological Disorders and Stroke convened major stakeholders in June 2012 to discuss how to improve the methodological reporting of animal studies in grant applications and publications. The main workshop recommendation is that at a minimum studies should report on sample-size estimation, whether and how animals were randomized, whether investigators were blind to the treatment, and the handling of data. We recognize that achieving a meaningful improvement in the quality of reporting will require a concerted effort by investigators, reviewers, funding agencies and journal editors. Requiring better reporting of animal studies will raise awareness of the importance of rigorous study design to accelerate scientific progress.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            An Agenda for Purely Confirmatory Research.

            The veracity of substantive research claims hinges on the way experimental data are collected and analyzed. In this article, we discuss an uncomfortable fact that threatens the core of psychology's academic enterprise: almost without exception, psychologists do not commit themselves to a method of data analysis before they see the actual data. It then becomes tempting to fine tune the analysis to the data in order to obtain a desired result-a procedure that invalidates the interpretation of the common statistical tests. The extent of the fine tuning varies widely across experiments and experimenters but is almost impossible for reviewers and readers to gauge. To remedy the situation, we propose that researchers preregister their studies and indicate in advance the analyses they intend to conduct. Only these analyses deserve the label "confirmatory," and only for these analyses are the common statistical tests valid. Other analyses can be carried out but these should be labeled "exploratory." We illustrate our proposal with a confirmatory replication attempt of a study on extrasensory perception.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Rescuing US biomedical research from its systemic flaws.

              The long-held but erroneous assumption of never-ending rapid growth in biomedical science has created an unsustainable hypercompetitive system that is discouraging even the most outstanding prospective students from entering our profession--and making it difficult for seasoned investigators to produce their best work. This is a recipe for long-term decline, and the problems cannot be solved with simplistic approaches. Instead, it is time to confront the dangers at hand and rethink some fundamental features of the US biomedical research ecosystem.
                Bookmark

                Author and article information

                Contributors
                Role: Reviewing editor
                Journal
                eLife
                eLife
                eLife
                eLife
                eLife Sciences Publications, Ltd
                2050-084X
                2050-084X
                10 December 2014
                2014
                : 3
                : e04333
                Affiliations
                [1] Timothy M ErringtonCenter for Open Science , Charlottesville, United States
                [2] Elizabeth IornsScience Exchange , Palo Alto, United States
                [4] Fraser Elisabeth TanScience Exchange , Palo Alto, United States
                [5] Joelle LomaxScience Exchange , Palo Alto, United States
                [3] William GunnMendeley , London, United Kingdom
                [6] Brian A NosekUniversity of Virginia , Charlottesville, United States; Center for Open Science , Charlottesville, United States
                eLife , United Kingdom
                Author notes
                [* ]For correspondence: tim@ 123456cos.io (TME);
                Author information
                http://orcid.org/0000-0002-4959-5143
                Article
                04333
                10.7554/eLife.04333
                4270077
                25490932
                737aa97c-ce5c-42d5-83f4-526da0f25785
                Copyright © 2014, Errington et al

                This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.

                History
                Funding
                Funded by: universityLaura and John Arnold Foundation;
                Award Recipient :
                The Reproducibility Project: Cancer Biology is funded by the Laura and John Arnold Foundation, provided to the Center for Open Science in collaboration with Science Exchange. The funder had no role in study design or the decision to submit the work for publication.
                Categories
                Feature Article
                Human Biology and Medicine
                Science Forum
                Custom metadata
                2.0
                The Reproducibility Project: Cancer Biology will generate a high-quality dataset to explore questions about the reproducibility of research, and will make all data, analysis and other research materials openly available to the research community.

                Life sciences
                reproducibility project: cancer biology,methodology,open science,reproducibility,replication,human,mouse

                Comments

                Comment on this article