73
views
0
recommends
+1 Recommend
1 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Background

          Preprint usage is growing rapidly in the life sciences; however, questions remain on the relative quality of preprints when compared to published articles. An objective dimension of quality that is readily measurable is completeness of reporting, as transparency can improve the reader’s ability to independently interpret data and reproduce findings.

          Methods

          In this observational study, we initially compared independent samples of articles published in bioRxiv and in PubMed-indexed journals in 2016 using a quality of reporting questionnaire. After that, we performed paired comparisons between preprints from bioRxiv to their own peer-reviewed versions in journals.

          Results

          Peer-reviewed articles had, on average, higher quality of reporting than preprints, although the difference was small, with absolute differences of 5.0% [95% CI 1.4, 8.6] and 4.7% [95% CI 2.4, 7.0] of reported items in the independent samples and paired sample comparison, respectively. There were larger differences favoring peer-reviewed articles in subjective ratings of how clearly titles and abstracts presented the main findings and how easy it was to locate relevant reporting information. Changes in reporting from preprints to peer-reviewed versions did not correlate with the impact factor of the publication venue or with the time lag from bioRxiv to journal publication.

          Conclusions

          Our results suggest that, on average, publication in a peer-reviewed journal is associated with improvement in quality of reporting. They also show that quality of reporting in preprints in the life sciences is within a similar range as that of peer-reviewed articles, albeit slightly lower on average, supporting the idea that preprints should be considered valid scientific contributions.

          Supplementary Information

          The online version contains supplementary material available at 10.1186/s41073-020-00101-3.

          Related collections

          Most cited references34

          • Record: found
          • Abstract: found
          • Article: found
          Is Open Access

          Improving Bioscience Research Reporting: The ARRIVE Guidelines for Reporting Animal Research

          In the last decade the number of bioscience journals has increased enormously, with many filling specialised niches reflecting new disciplines and technologies. The emergence of open-access journals has revolutionised the publication process, maximising the availability of research data. Nevertheless, a wealth of evidence shows that across many areas, the reporting of biomedical research is often inadequate, leading to the view that even if the science is sound, in many cases the publications themselves are not “fit for purpose,” meaning that incomplete reporting of relevant information effectively renders many publications of limited value as instruments to inform policy or clinical and scientific practice [1]–[21]. A recent review of clinical research showed that there is considerable cumulative waste of financial resources at all stages of the research process, including as a result of publications that are unusable due to poor reporting [22]. It is unlikely that this issue is confined to clinical research [2]–[14],[16]–[20]. Failure to describe research methods and to report results appropriately therefore has potential scientific, ethical, and economic implications for the entire research process and the reputation of those involved in it. This is particularly true for animal research, one of the most controversial areas of science. The largest and most comprehensive review of published animal research undertaken to date, to our knowledge, has highlighted serious omissions in the way research using animals is reported [5]. The survey, commissioned by the National Centre for the Replacement, Refinement and Reduction of Animals in Research (NC3Rs), a UK Government-sponsored scientific organisation, found that only 59% of the 271 randomly chosen articles assessed stated the hypothesis or objective of the study, and the number and characteristics of the animals used (i.e., species/strain, sex, and age/weight). Most of the papers surveyed did not report using randomisation (87%) or blinding (86%) to reduce bias in animal selection and outcome assessment. Only 70% of the publications that used statistical methods fully described them and presented the results with a measure of precision or variability [5]. These findings are a cause for concern and are consistent with reviews of many research areas, including clinical studies, published in recent years [2]–[22]. Good Reporting Is Essential for Peer Review and to Inform Future Research Scrutiny by scientific peers has long been the mainstay of “quality control” for the publication process. The way that experiments are reported, in terms of the level of detail of methods and the presentation of key results, is crucial to the peer review process and, indeed, the subsequent utility and validity of the knowledge base that is used to inform future research. The onus is therefore on the research community to ensure that their research articles include all relevant information to allow in-depth critique, and to avoiding duplicating studies and performing redundant experiments. Ideally scientific publications should present sufficient information to allow a knowledgeable reader to understand what was done, why, and how, and to assess the biological relevance of the study and the reliability and validity of the findings. There should also be enough information to allow the experiment to be repeated [23]. The problem therefore is how to ensure that all relevant information is included in research publications. Using Reporting Guidelines Measurably Improves the Quality of Reporting Evidence provided by reviews of published research suggests that many researchers and peer reviewers would benefit from guidance about what information should be provided in a research article. The CONSORT Statement for randomised controlled clinical trials was one of the first guidelines developed in response to this need [24],[25]. Since publication, an increasing number of leading journals have supported CONSORT as part of their instructions to authors [26],[27]. As a result, convincing evidence is emerging that CONSORT improves the quality and transparency of reports of clinical trials [28],[29]. Following CONSORT, many other guidelines have been developed—there are currently more than 90 available for reporting different types of health research, most of which have been published in the last ten years (see http://www.equator-network.org and references [30],[31]). Guidelines have also been developed to improve the reporting of other specific bioscience research areas including metabolomics and gene expression studies [32]–[37]. Several organisations support the case for improved reporting and recommend the use of reporting guidelines, including the International Committee of Medical Journal Editors, the Council of Science Editors, the Committee on Publication Ethics, and the Nuffield Council for Bioethics [38]–[41]. Improving the Reporting of Animal Experiments—The ARRIVE Guidelines Most bioscience journals currently provide little or no guidance on what information to report when describing animal research [42]–[50]. Our review found that 4% of the 271 journal articles assessed did not report the number of animals used anywhere in the methods or the results sections [5]. Reporting animal numbers is essential so that the biological and statistical significance of the experimental results can be assessed or the data reanalysed, and is also necessary if the experimental methods are to be repeated. Improved reporting of these and other details will maximise the availability and utility of the information gained from every animal and every experiment, preventing unnecessary animal use in the future. To address this, we led an initiative to produce guidelines for reporting animal research. The guidelines, referred to as ARRIVE (Animals in Research: Reporting In Vivo Experiments), have been developed using the CONSORT Statement as their foundation [24],[25]. The ARRIVE guidelines consist of a checklist of 20 items describing the minimum information that all scientific publications reporting research using animals should include, such as the number and specific characteristics of animals used (including species, strain, sex, and genetic background); details of housing and husbandry; and the experimental, statistical, and analytical methods (including details of methods used to reduce bias such as randomisation and blinding). All the items in the checklist have been included to promote high-quality, comprehensive reporting to allow an accurate critical review of what was done and what was found. Consensus and consultation are the corner-stones of the guideline development process [51]. To maximise their utility, the ARRIVE guidelines have been prepared in consultation with scientists, statisticians, journal editors, and research funders. We convened an expert working group, comprising researchers and statisticians from a range of disciplines, and journal editors from Nature Cell Biology, Science, Laboratory Animals, and the British Journal of Pharmacology (see Acknowledgments). At a one-day meeting in June 2009, the working group agreed the scope and broad content of a draft set of guidelines that were then used as the basis for a wider consultation with the scientific community, involving researchers, and grant holders and representatives of the major bioscience funding bodies including the Medical Research Council, Wellcome Trust, Biotechnology and Biological Sciences Research Council, and The Royal Society (see Table 1). Feedback on the content and wording of the items was incorporated into the final version of the checklist. Further feedback on the content utility of the guidelines is encouraged and sought. 10.1371/journal.pbio.1000412.t001 Table 1 Funding bodies consulted. Name of Bioscience Research Funding Body Medical Research Council Biotechnology and Biological Sciences Research Council Wellcome Trust The Royal Society Association of Medical Research Charities British Heart Foundation Parkinson's Disease Society The ARRIVE guidelines (see Table 2) can be applied to any area of bioscience research using laboratory animals, and the inherent principles apply not only to reporting comparative experiments but also to other study designs. Laboratory animal refers to any species of animal undergoing an experimental procedure in a research laboratory or formal test setting. The guidelines are not intended to be mandatory or absolutely prescriptive, nor to standardise or formalise the structure of reporting. Rather they provide a checklist that can be used to guide authors preparing manuscripts for publication, and by those involved in peer review for quality assurance, to ensure completeness and transparency. 10.1371/journal.pbio.1000412.t002 Table 2 Animal Research: Reporting In Vivo experiments: The ARRIVE guidelines. ITEM RECOMMENDATION TITLE 1 Provide as accurate and concise a description of the content of the article as possible. ABSTRACT 2 Provide an accurate summary of the background, research objectives (including details of the species or strain of animal used), key methods, principal findings, and conclusions of the study. INTRODUCTION Background 3 a. Include sufficient scientific background (including relevant references to previous work) to understand the motivation and context for the study, and explain the experimental approach and rationale.b. Explain how and why the animal species and model being used can address the scientific objectives and, where appropriate, the study's relevance to human biology. Objectives 4 Clearly describe the primary and any secondary objectives of the study, or specific hypotheses being tested. METHODS Ethical statement 5 Indicate the nature of the ethical review permissions, relevant licences (e.g. Animal [Scientific Procedures] Act 1986), and national or institutional guidelines for the care and use of animals, that cover the research. Study design 6 For each experiment, give brief details of the study design, including:a. The number of experimental and control groups.b. Any steps taken to minimise the effects of subjective bias when allocating animals to treatment (e.g., randomisation procedure) and when assessing results (e.g., if done, describe who was blinded and when).c. The experimental unit (e.g. a single animal, group, or cage of animals).A time-line diagram or flow chart can be useful to illustrate how complex study designs were carried out. Experimental procedures 7 For each experiment and each experimental group, including controls, provide precise details of all procedures carried out. For example:a. How (e.g., drug formulation and dose, site and route of administration, anaesthesia and analgesia used [including monitoring], surgical procedure, method of euthanasia). Provide details of any specialist equipment used, including supplier(s).b. When (e.g., time of day).c. Where (e.g., home cage, laboratory, water maze).d. Why (e.g., rationale for choice of specific anaesthetic, route of administration, drug dose used). Experimental animals 8 a. Provide details of the animals used, including species, strain, sex, developmental stage (e.g., mean or median age plus age range), and weight (e.g., mean or median weight plus weight range).b. Provide further relevant information such as the source of animals, international strain nomenclature, genetic modification status (e.g. knock-out or transgenic), genotype, health/immune status, drug- or test-naïve, previous procedures, etc. Housing and husbandry 9 Provide details of:a. Housing (e.g., type of facility, e.g., specific pathogen free (SPF); type of cage or housing; bedding material; number of cage companions; tank shape and material etc. for fish).b. Husbandry conditions (e.g., breeding programme, light/dark cycle, temperature, quality of water etc. for fish, type of food, access to food and water, environmental enrichment).c. Welfare-related assessments and interventions that were carried out before, during, or after the experiment. Sample size 10 a. Specify the total number of animals used in each experiment and the number of animals in each experimental group.b. Explain how the number of animals was decided. Provide details of any sample size calculation used.c. Indicate the number of independent replications of each experiment, if relevant. Allocating animals to experimental groups 11 a. Give full details of how animals were allocated to experimental groups, including randomisation or matching if done.b. Describe the order in which the animals in the different experimental groups were treated and assessed. Experimental outcomes 12 Clearly define the primary and secondary experimental outcomes assessed (e.g., cell death, molecular markers, behavioural changes). Statistical methods 13 a. Provide details of the statistical methods used for each analysis.b. Specify the unit of analysis for each dataset (e.g. single animal, group of animals, single neuron).c. Describe any methods used to assess whether the data met the assumptions of the statistical approach. RESULTS Baseline data 14 For each experimental group, report relevant characteristics and health status of animals (e.g., weight, microbiological status, and drug- or test-naïve) before treatment or testing (this information can often be tabulated). Numbers analysed 15 a. Report the number of animals in each group included in each analysis. Report absolute numbers (e.g. 10/20, not 50%a).b. If any animals or data were not included in the analysis, explain why. Outcomes and estimation 16 Report the results for each analysis carried out, with a measure of precision (e.g., standard error or confidence interval). Adverse events 17 a. Give details of all important adverse events in each experimental group.b. Describe any modifications to the experimental protocols made to reduce adverse events. DISCUSSION Interpretation/scientific implications 18 a. Interpret the results, taking into account the study objectives and hypotheses, current theory, and other relevant studies in the literature.b. Comment on the study limitations including any potential sources of bias, any limitations of the animal model, and the imprecision associated with the resultsa.c. Describe any implications of your experimental methods or findings for the replacement, refinement, or reduction (the 3Rs) of the use of animals in research. Generalisability/translation 19 Comment on whether, and how, the findings of this study are likely to translate to other species or systems, including any relevance to human biology. Funding 20 List all funding sources (including grant number) and the role of the funder(s) in the study. a Schulz, et al. (2010) [24]. Improved Reporting Will Maximise the Output of Published Research These guidelines were developed to maximise the output from research using animals by optimising the information that is provided in publications on the design, conduct, and analysis of the experiments. The need for such guidelines is further illustrated by the systematic reviews of animal research that have been carried out to assess the efficacy of various drugs and interventions in animal models [8],[9],[13],[52]–[55]. Well-designed and -reported animal studies are the essential building blocks from which such a systematic review is constructed. The reviews have found that, in many cases, reporting omissions, in addition to the limitations of the animal models used in the individual studies assessed in the review, are a barrier to reaching any useful conclusion about the efficacy of the drugs and interventions being compared [2],[3]. Driving improvements in reporting research using animals will require the collective efforts of authors, journal editors, peer reviewers, and funding bodies. There is no single simple or rapid solution, but the ARRIVE guidelines provide a practical resource to aid these improvements. The guidelines will be published in several leading bioscience research journals simultaneously [56]–[60], and publishers have already endorsed the guidelines by including them in their journal Instructions to Authors subsequent to publication. The NC3Rs will continue to work with journal editors to extend the range of journals adopting the guidelines, and with the scientific community to disseminate the guidelines as widely as possible (http://www.nc3rs.org.uk/ARRIVE).
            Bookmark
            • Record: found
            • Abstract: not found
            • Article: not found

            The ASA's Statement onp-Values: Context, Process, and Purpose

              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies

              Introduction Many questions in medical research are investigated in observational studies [1]. Much of the research into the cause of diseases relies on cohort, case-control, or cross-sectional studies. Observational studies also have a role in research into the benefits and harms of medical interventions [2]. Randomised trials cannot answer all important questions about a given intervention. For example, observational studies are more suitable to detect rare or late adverse effects of treatments, and are more likely to provide an indication of what is achieved in daily medical practice [3]. Research should be reported transparently so that readers can follow what was planned, what was done, what was found, and what conclusions were drawn. The credibility of research depends on a critical assessment by others of the strengths and weaknesses in study design, conduct, and analysis. Transparent reporting is also needed to judge whether and how results can be included in systematic reviews [4,5]. However, in published observational research important information is often missing or unclear. An analysis of epidemiological studies published in general medical and specialist journals found that the rationale behind the choice of potential confounding variables was often not reported [6]. Only few reports of case-control studies in psychiatry explained the methods used to identify cases and controls [7]. In a survey of longitudinal studies in stroke research, 17 of 49 articles (35%) did not specify the eligibility criteria [8]. Others have argued that without sufficient clarity of reporting, the benefits of research might be achieved more slowly [9], and that there is a need for guidance in reporting observational studies [10,11]. Recommendations on the reporting of research can improve reporting quality. The Consolidated Standards of Reporting Trials (CONSORT) Statement was developed in 1996 and revised 5 years later [12]. Many medical journals supported this initiative [13], which has helped to improve the quality of reports of randomised trials [14,15]. Similar initiatives have followed for other research areas—e.g., for the reporting of meta-analyses of randomised trials [16] or diagnostic studies [17]. We established a network of methodologists, researchers, and journal editors to develop recommendations for the reporting of observational research: the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement. Aims and Use of the STROBE Statement The STROBE Statement is a checklist of items that should be addressed in articles reporting on the 3 main study designs of analytical epidemiology: cohort, case-control, and cross-sectional studies. The intention is solely to provide guidance on how to report observational research well: these recommendations are not prescriptions for designing or conducting studies. Also, while clarity of reporting is a prerequisite to evaluation, the checklist is not an instrument to evaluate the quality of observational research. Here we present the STROBE Statement and explain how it was developed. In a detailed companion paper, the Explanation and Elaboration article [18–20], we justify the inclusion of the different checklist items and give methodological background and published examples of what we consider transparent reporting. We strongly recommend using the STROBE checklist in conjunction with the explanatory article, which is available freely on the Web sites of PLoS Medicine (http://www.plosmedicine.org/), Annals of Internal Medicine (http://www.annals.org/), and Epidemiology (http://www.epidem.com/). Development of the STROBE Statement We established the STROBE Initiative in 2004, obtained funding for a workshop and set up a Web site (http://www.strobe-statement.org/). We searched textbooks, bibliographic databases, reference lists, and personal files for relevant material, including previous recommendations, empirical studies of reporting and articles describing relevant methodological research. Because observational research makes use of many different study designs, we felt that the scope of STROBE had to be clearly defined early on. We decided to focus on the 3 study designs that are used most widely in analytical observational research: cohort, case-control, and cross-sectional studies. We organised a 2-day workshop in Bristol, UK, in September 2004. 23 individuals attended this meeting, including editorial staff from Annals of Internal Medicine, BMJ, Bulletin of the World Health Organization, International Journal of Epidemiology, JAMA, Preventive Medicine, and The Lancet, as well as epidemiologists, methodologists, statisticians, and practitioners from Europe and North America. Written contributions were sought from 10 other individuals who declared an interest in contributing to STROBE, but could not attend. Three working groups identified items deemed to be important to include in checklists for each type of study. A provisional list of items prepared in advance (available from our Web site) was used to facilitate discussions. The 3 draft checklists were then discussed by all participants and, where possible, items were revised to make them applicable to all three study designs. In a final plenary session, the group decided on the strategy for finalizing and disseminating the STROBE Statement. After the workshop we drafted a combined checklist including all three designs and made it available on our Web site. We invited participants and additional scientists and editors to comment on this draft checklist. We subsequently published 3 revisions on the Web site, and 2 summaries of comments received and changes made. During this process the coordinating group (i.e., the authors of the present paper) met on eight occasions for 1 or 2 days and held several telephone conferences to revise the checklist and to prepare the present paper and the Explanation and Elaboration paper [18–20]. The coordinating group invited 3 additional co-authors with methodological and editorial expertise to help write the Explanation and Elaboration paper, and sought feedback from more than 30 people, who are listed at the end of this paper. We allowed several weeks for comments on subsequent drafts of the paper and reminded collaborators about deadlines by e-mail. STROBE Components The STROBE Statement is a checklist of 22 items that we consider essential for good reporting of observational studies (Table 1). These items relate to the article's title and abstract (item 1), the introduction (items 2 and 3), methods (items 4–12), results (items 13–17) and discussion sections (items 18–21), and other information (item 22 on funding). 18 items are common to all three designs, while four (items 6, 12, 14, and 15) are design-specific, with different versions for all or part of the item. For some items (indicated by asterisks), information should be given separately for cases and controls in case-control studies, or exposed and unexposed groups in cohort and cross-sectional studies. Although presented here as a single checklist, separate checklists are available for each of the 3 study designs on the STROBE Web site. Table 1 The STROBE Statement—Checklist of Items That Should Be Addressed in Reports of Observational Studies Implications and Limitations The STROBE Statement was developed to assist authors when writing up analytical observational studies, to support editors and reviewers when considering such articles for publication, and to help readers when critically appraising published articles. We developed the checklist through an open process, taking into account the experience gained with previous initiatives, in particular CONSORT. We reviewed the relevant empirical evidence as well as methodological work, and subjected consecutive drafts to an extensive iterative process of consultation. The checklist presented here is thus based on input from a large number of individuals with diverse backgrounds and perspectives. The comprehensive explanatory article [18–20], which is intended for use alongside the checklist, also benefited greatly from this consultation process. Observational studies serve a wide range of purposes, on a continuum from the discovery of new findings to the confirmation or refutation of previous findings [18–20]. Some studies are essentially exploratory and raise interesting hypotheses. Others pursue clearly defined hypotheses in available data. In yet another type of studies, the collection of new data is planned carefully on the basis of an existing hypothesis. We believe the present checklist can be useful for all these studies, since the readers always need to know what was planned (and what was not), what was done, what was found, and what the results mean. We acknowledge that STROBE is currently limited to three main observational study designs. We would welcome extensions that adapt the checklist to other designs—e.g., case-crossover studies or ecological studies—and also to specific topic areas. Four extensions are now available for the CONSORT statement [21–24]. A first extension to STROBE is underway for gene-disease association studies: the STROBE Extension to Genetic Association studies (STREGA) initiative [25]. We ask those who aim to develop extensions of the STROBE Statement to contact the coordinating group first to avoid duplication of effort. The STROBE Statement should not be interpreted as an attempt to prescribe the reporting of observational research in a rigid format. The checklist items should be addressed in sufficient detail and with clarity somewhere in an article, but the order and format for presenting information depends on author preferences, journal style, and the traditions of the research field. For instance, we discuss the reporting of results under a number of separate items, while recognizing that authors might address several items within a single section of text or in a table. Also, item 22, on the source of funding and the role of funders, could be addressed in an appendix or in the methods section of the article. We do not aim at standardising reporting. Authors of randomised clinical trials were asked by an editor of a specialist medical journal to “CONSORT” their manuscripts on submission [26]. We believe that manuscripts should not be “STROBEd”, in the sense of regulating style or terminology. We encourage authors to use narrative elements, including the description of illustrative cases, to complement the essential information about their study, and to make their articles an interesting read [27]. We emphasise that the STROBE Statement was not developed as a tool for assessing the quality of published observational research. Such instruments have been developed by other groups and were the subject of a recent systematic review [28]. In the Explanation and Elaboration paper, we used several examples of good reporting from studies whose results were not confirmed in further research – the important feature was the good reporting, not whether the research was of good quality. However, if STROBE is adopted by authors and journals, issues such as confounding, bias, and generalisability could become more transparent, which might help temper the over-enthusiastic reporting of new findings in the scientific community and popular media [29], and improve the methodology of studies in the long term. Better reporting may also help to have more informed decisions about when new studies are needed, and what they should address. We did not undertake a comprehensive systematic review for each of the checklist items and sub-items, or do our own research to fill gaps in the evidence base. Further, although no one was excluded from the process, the composition of the group of contributors was influenced by existing networks and was not representative in terms of geography (it was dominated by contributors from Europe and North America) and probably was not representative in terms of research interests and disciplines. We stress that STROBE and other recommendations on the reporting of research should be seen as evolving documents that require continual assessment, refinement, and, if necessary, change. We welcome suggestions for the further dissemination of STROBE—e.g., by re-publication of the present article in specialist journals and in journals published in other languages. Groups or individuals who intend to translate the checklist to other languages should consult the coordinating group beforehand. We will revise the checklist in the future, taking into account comments, criticism, new evidence, and experience from its use. We invite readers to submit their comments via the STROBE Web site (http://www.strobe-statement.org/).
                Bookmark

                Author and article information

                Contributors
                clarissa.franca@bioqmed.ufrj.br
                Journal
                Res Integr Peer Rev
                Res Integr Peer Rev
                Research Integrity and Peer Review
                BioMed Central (London )
                2058-8615
                1 December 2020
                1 December 2020
                2020
                : 5
                : 16
                Affiliations
                [1 ]GRID grid.8536.8, ISNI 0000 0001 2294 473X, Institute of Medical Biochemistry Leopoldo de Meis, , Federal University of Rio de Janeiro, ; Rio de Janeiro, RJ 21941-902 Brazil
                [2 ]GRID grid.419134.a, ISNI 0000 0004 0620 4442, Seção de Arbovirologia e Febres Hemorrágicas, , Instituto Evandro Chagas, ; Ananindeua, Pará Brazil
                [3 ]GRID grid.442052.5, Departamento de Patologia, , Universidade do Estado do Pará, ; Belém, Pará Brazil
                [4 ]GRID grid.442049.f, ISNI 0000 0000 9691 9716, Centro Universitário Metropolitano da Amazônia, , Instituto Euro-Americano de Educação, Ciência e Tecnologia, ; Belém, Pará Brazil
                [5 ]GRID grid.8532.c, ISNI 0000 0001 2200 7498, Departamento de Bioquímica, Instituto de Ciências Básicas da Saúde, , Universidade Federal do Rio Grande do Sul, ; Porto Alegre, Rio Grande do Sul Brazil
                [6 ]GRID grid.8536.8, ISNI 0000 0001 2294 473X, Biomedical Sciences Institute, , Federal University of Rio de Janeiro, ; Rio de Janeiro, Brazil
                [7 ]GRID grid.4305.2, ISNI 0000 0004 1936 7988, University of Edinburgh Medical School, ; Edinburgh, Scotland, UK
                [8 ]GRID grid.411249.b, ISNI 0000 0001 0514 7202, Programa de Pós-Graduação em Psicobiologia, , Universidade Federal de São Paulo, ; São Paulo, Brazil
                [9 ]GRID grid.17635.36, ISNI 0000000419368657, Department of Psychiatry, , University of Minnesota, ; Minneapolis, MN USA
                [10 ]GRID grid.8993.b, ISNI 0000 0004 1936 9457, Department of Neuroscience, , Uppsala University, ; Uppsala, Sweden
                [11 ]GRID grid.418800.5, ISNI 0000 0004 0555 4846, Institute of Microbiology of the Czech Academy of Sciences, ; Prague, Czech Republic
                [12 ]GRID grid.17635.36, ISNI 0000000419368657, Department of Genetics, Cell Biology, and Development, , University of Minnesota, ; Minneapolis, MN USA
                [13 ]GRID grid.35403.31, ISNI 0000 0004 1936 9991, Carl R Woese Institute for Genomic Biology, , University of Illinois at Urbana-Champaign, ; Champaign, IL USA
                [14 ]GRID grid.419134.a, ISNI 0000 0004 0620 4442, Seção de Virologia, , Instituto Evandro Chagas, ; Ananindeua, Pará Brazil
                [15 ]GRID grid.442052.5, Departamento de Morfologia e Ciências Fisiológicas, , Universidade do Estado do Pará, ; Belém, Pará Brazil
                Author information
                http://orcid.org/0000-0001-8127-0034
                Article
                101
                10.1186/s41073-020-00101-3
                7706207
                33292815
                b041a0c4-d405-49a2-bbd7-3a6b747270e5
                © The Author(s) 2020

                Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

                History
                : 26 May 2020
                : 22 October 2020
                Funding
                Funded by: FundRef http://dx.doi.org/10.13039/501100004586, Fundação Carlos Chagas Filho de Amparo à Pesquisa do Estado do Rio de Janeiro;
                Funded by: FundRef http://dx.doi.org/10.13039/501100003593, Conselho Nacional de Desenvolvimento Científico e Tecnológico;
                Funded by: Programa Institucional de Bolsas de Iniciação Científica - UFRJ
                Categories
                Research
                Custom metadata
                © The Author(s) 2020

                quality of reporting,preprint,peer review,publication,biorxiv,scientific journal

                Comments

                Comment on this article