15
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Protocols—more structure, less ‘ Wuthering Heights

      editorial
      Trials
      BioMed Central

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Many years ago I went through a phase of reading classic novels, books written by authors we’ve all heard of who are now dead. I ended up keeping just one of these: Wuthering Heights. Emily Brontë’s novel centres on the fiery love between man of mystery Heathcliff and Catherine Earnshaw, the latter of whom inconveniently dies halfway through the book. On Catherine’s death, Heathcliff’s desperate response is: And I pray one prayer—I repeat it till my tongue stiffens—Catherine Earnshaw, may you not rest as long as I am living! You said I killed you—haunt me, then!…Be with me always—take any form—drive me mad! only do not leave me in this abyss, where I cannot find you! Gripping stuff. The reason for raising this topic is that finding this quote in the book was hard work despite my knowing it was in there somewhere. The presentation format of Wuthering Heights does not make finding things easy; you’re supposed to start at the beginning and keep going.1 For a novel this hardly matters; few people pick up Wuthering Heights just to find out what Heathcliff said when Catherine died. But it does matter for trial protocols. People do look at these protocols just to find out how the randomisation was done, or what the primary outcome is, or how adverse events will be collected. Even when information is present in a protocol, finding it can be frustratingly difficult. This is a sorry state of affairs precisely because we do dip in and out of protocols so much. The Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) checklist [1] recommends what should be in a protocol but not where it should be. Consequently, navigating a protocol can be maddening. Apart from wasting everyone’s time, it makes it easier for methodological weakness, error and poor practice to pass unseen. In 2015 our late founding editor Doug Altman suggested that we should make greater use of structure in research articles [2]. Structured information of the sort seen in trial registries is in contrast to what I think of as the ‘Wuthering Heights’ approach to research reporting: material written so that you have to start at the beginning and keep going. But we are not writing novels. We are providing information that should be clear, complete and, crucially, easy to navigate. To make protocols less ‘Wuthering Heights’, Trials is experimenting with a new way to structure the protocol for a randomised trial. The simple innovation is to include all the SPIRIT headings and item identifiers in the protocol itself. We then know what has to be in the protocol and where to put it. We can see—quickly—when information is missing. If you, the authors, want to add additional headings, specific to your trial, go ahead. If you’d like to add the pdf of the protocol you submitted to your ethics committee (in any language) as a supplementary document, please do. We’ve reformatted the protocol for the AMBER trial, which was published in Trials in 2017 [3], into this new structured format so that you can compare it to the original; see Additional file 1. A newly submitted protocol has also used this format [4] (https://trialsjournal.biomedcentral.com/articles/10.1186/s13063-019-3500-7). In both cases you’ll see that it’s not so different to what we’re all used to. These protocols do, however, have something written under all 51 items of the SPIRIT checklist, which was not quite the case for the AMBER protocol that had been published already. To make things easier, we’ve created a template for this new format that contains both SPIRIT and Trials guidance in one place: https://trialsjournal.biomedcentral.com/submission-guidelines/preparing-your-manuscript/study-protocol/structured-study-protocol-template. We’ve changed the ordering of some SPIRIT items in the template to make it flow better, but all the original SPIRIT item identifiers are there. If what matters to you is how harms are collected and assessed, searching for ‘{22}’ in one of these structured protocols will always land you in the right place. Typing ‘{6b}’ will always take you to the rationale behind the comparators. In short, readers can search the headings, find what is needed and ignore the rest if they want to. Trials is not making use of this structure mandatory, and we will continue to consider protocols submitted in other formats. All will continue to be checked against the SPIRIT checklist. But we think the new structured approach will improve reporting (as it did for the previously published AMBER protocol) and improve publication times because the cross-check with SPIRIT will be much easier. The protocol is likely to be a more useful tool for those inside and outside the trial team who need to refer to it. As Doug wrote in 2015, despite improved communication about trials being part of the editorial that launched Trials, there hasn’t been much activity on this theme [2]. Well, here’s to structured protocols. Supplementary information Additional file 1. The AMBER protocol after reformatting using the structured protocol template.

          Related collections

          Most cited references3

          • Record: found
          • Abstract: found
          • Article: found
          Is Open Access

          Making research articles fit for purpose: structured reporting of key methods and findings

          ‘If physicians are to base treatment decisions on the evidence in the medical literature, all the relevant results of trials must be available easily and consistently. Yet it is common to have trouble identifying the hypothesis, the research question, and the design of a published trial. It is even more common to lose count of the participants or to be unable to tell who received what therapies and the type of analysis used. As a result, it is often impossible to know whether the conclusions are justified by the data’ [1]. There is a big problem with journal articles. Readers of published research reports, especially systematic reviewers, struggle to find key details of study methods and often cannot extract the results they seek [1]. Many research articles are clearly unfit for purpose [2]. What is the solution? One way is to develop text-mining software to locate the relevant information, and several groups are working on such initiatives [3-5]. But text-mining is only a potential solution for extracting information that is in fact there, albeit hard to locate; it cannot assist at all for information that is simply absent from the research report. There is a wealth of evidence that key information is commonly missing from published reports of trials [6,7]. So while text-mining software could be useful for existing literature, going forwards with it is a solution to the wrong problem. Instead, I believe we need to consider a different format for publishing research results. Research reports published in journal articles serve multiple readerships, each with different needs. Regardless of length and style, it is essential that such articles include all relevant details of the study methods and the key findings. Two fundamental principles are that a research article should include enough information about the methodology to allow others to replicate the study, and the results should be given in enough detail to enable them to be included in a subsequent systematic review and meta-analysis [8]. In principle the format of a report is irrelevant if those criteria are met. However, the current standard story-telling format embeds factual information and numerical results within the narrative text, making some details hard to extract and, crucially, masking the absence of essential material. These problems affect all types of research but the seriousness is arguably greatest in relation to reports of randomised trials, which I will consider here. Deficiencies in journal articles Reporting guidelines emerged in the 1990s in response to the abundant evidence of missing or ambiguous information in published research reports [9,10]. The Consolidated Standards of Reporting Trials (CONSORT) Statement, first published in 1996 and most recently updated in 2010 [11], outlines the minimum information that should be included in reports of the results of randomised trials. Approaching 20 years since its first appearance, its benefit on reporting has been clearly seen, but with only modest improvement over time [12]. Several hundred journals have stated support for, or adoption of, CONSORT, but adherence remains inadequate. Dozens of recent reviews have shown that reporting of essential information continues to be generally inadequate in trial reports across all areas of medicine [6,7,13,14]. The present situation is clearly unacceptable. Various ideas are being explored to improve the quality of publications including some targeted at editorial processes. Indeed improved reporting has been demonstrated when editorial resources are focused specifically on adherence to CONSORT [15-17]. One possibility that needs serious consideration is to change the format of research articles by introducing more structure. Structured reporting has been introduced in areas of clinical practice. Improved completeness and clinical value have been demonstrated, for example in pathology [18], radiology [19], and telemedicine [20]. Structure in research reports began with the adoption of the IMRAD format (Introduction, Methods, Results and Discussion) augmented by the adoption of structured abstracts [21]. Although in each case there were fears that the structure would stifle creativity, both succeeded because of their self-evident benefit on the quality of published articles [22]. Structured reporting of research articles Within medical research, trial registers provide a perfect example of structured reporting. So, for example, registering a study on clinicaltrials.gov requires completion of a structured template. Likewise, in the section for subsequent reporting of the results, researchers have to provide the study findings in a structured way. It has been shown that some results posted on clinicaltrials.gov, especially harms, are more complete than those in corresponding journal articles reporting the same trials [23,24]. Journal articles that report research findings are currently in a mainly narrative style, usually supported by tables and perhaps also figures. As Riveros and colleagues observed, ‘using templates with mandatory reporting of some elements may facilitate the work of researchers by reminding them what they need to report and by standardising their reporting’ [23]. It is timely to consider whether journal articles would be more informative if they had more structure. There are two main forms of structure. First, more structure can be applied to the main text by creating many more sections. One of the antecedents of CONSORT was SORT (Standards of Reporting Trials), a reporting guideline that referred to structured reporting in its title [25]. The authors defined structured reporting as providing sufficiently detailed information about the design, conduct and analysis of the trial for the reader to have confidence that the report is an accurate reflection of what occurred during the various stages of the trial. A single published case study of using each item of the SORT checklist as a heading for a short section was widely considered to be a failure, as it made the article longer and less readable [22]. However, some of the criticisms were related more to the content of SORT than the format. Three subsequent generations of the development of CONSORT have addressed those concerns; it is not reasonable to continue to dismiss the principle of structure based on a single case study published 20 years ago using a different checklist. In fact, much the same idea has been implemented elsewhere. The journal PLoS Clinical Trials, published from 2006–2007, created a template based on the then current CONSORT checklist of 2001. Each item in the CONSORT checklist was used a heading in the article. Although this was in essence a repeat of the SORT approach, there were fewer headings and they were structured within the IMRAD format. Alternatively, authors can identify in the text where each element of the CONSORT checklist is addressed [26]. This approach has no impact on the format of the article, but requires the authors to mark up the text. While that format should help to avoid omissions, some checklist items do not refer to a specific piece of information in a single location, and so this is not in my view a workable solution in general. A different approach to structure is to adopt a more tabular format akin to completing a tax form, as is required for example on clinical trials registers. In fact, several structural elements are already routinely used in reports of randomised trials. Almost certainly the most successful impact of CONSORT has been the flow diagram, which is now included in the majority of published trial reports. The diagram depicts the flow of participants through the trial, from enrolment through allocation and follow up to analysis. Readers, including peer reviewers, can quickly see the numbers of randomised participants, identify when and why some were lost to follow-up, and the extent to which the numbers analysed reflect the numbers randomised. Other structures within most reports of trial results are a structured abstract and a table showing the baseline characteristics of each intervention group (usually as Table 1). But it is simple, and I believe desirable, to include other elements within explicit displays (tables or boxes), such as eligibility criteria, details of interventions, outcomes, and primary results. Currently, such information is rarely included as a display in published articles. The suggestion is intended to make key information easy to locate rather than to require a rigid format. Thus the same displays can easily accommodate the modified recommendations in several extensions to CONSORT (http://www.consort-statement.org/extensions). A similar idea has been proposed for articles reporting prognostic studies of tumour markers [27]. Readability is often put forward as an argument against structure. This would be a stronger argument if current research reports were highly readable, but many are not. One reason is that much factual information is embedded within the text, which works especially poorly for trial results. Readability is certainly desirable, but far more important are reliability and relevance [28], and crucially important too is reproducibility, which of course requires complete reporting. One reason for suggesting greater use of structural elements is to pull apart factual information from narrative, making it easier both to locate specific information and also to understand the broad sweep of a study without being diverted by all the details, important though they are. Greater use of structure within research articles (not just for randomised controlled trials) would improve completeness by helping authors ensure they address key issues. It would also greatly aid reviewers and editors in appraising articles, and it would assist future systematic reviewers who currently struggle to find the key information they seek. Indeed, more structure would also aid text-mining. In the future, trial results will perhaps appear only in registries, presumably in a highly structured format, with journals carrying only narrative discussions of their findings [29]. Such a radical change does not seem imminent, however. In the initial editorial published when Trials was launched, the editors wrote that ‘we believe that there is scope for new and better ways to report the findings of trials. Trials will develop and refine innovative approaches to improving communication about trials’ [30]. As yet there has been very little activity on this theme. We encourage contributions, both suggestions for suitable formats and also specific examples of real trial results presented in alternative formats. This editorial is thus the first contribution in a new Trials series on ‘New ways to publish research findings’.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: found
            Is Open Access

            Abdominal massage for neurogenic bowel dysfunction in people with multiple sclerosis (AMBER — Abdominal Massage for Bowel Dysfunction Effectiveness Research): study protocol for a randomised controlled trial

            Background Multiple sclerosis (MS) is a life-long condition primarily affecting younger adults. Neurogenic bowel dysfunction (NBD) occurs in 50–80% of these patients and is the term used to describe constipation and faecal incontinence, which often co-exist. Data from a pilot study suggested feasibility of using abdominal massage for the relief of constipation, but the effectiveness remains uncertain. Methods/design This is a multi-centred patient randomised superiority trial comparing an experimental strategy of once daily abdominal massage for 6 weeks against a control strategy of no massage in people with MS who have stated that their constipation is bothersome. The primary outcome is the Neurogenic Bowel Dysfunction Score at 24 weeks. Both groups will receive optimised advice plus the MS Society booklet on bowel management in MS, and will continue to receive usual care. Participants and their clinicians will not be blinded to the allocated intervention. Outcome measures are primarily self-reported and submitted anonymously. Central trial staff who will manage and analyse the trial data will be unaware of participant allocations. Analysis will follow intention-to-treat principles. Discussion This pragmatic randomised controlled trial will demonstrate if abdominal massage is an effective, cost-effective and viable addition to the treatment of NBD in people with MS. Trial registration ClinicalTrials.gov, ISRCTN85007023. Registered on 10 June 2014. Electronic supplementary material The online version of this article (doi:10.1186/s13063-017-1890-y) contains supplementary material, which is available to authorized users.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: found
              Is Open Access

              Reducing Asthma Attacks in Children using Exhaled Nitric Oxide as a biomarker to inform treatment strategy: a randomised trial (RAACENO)

              Background Childhood asthma is a common condition. Currently there is no validated objective test which can be used to guide asthma treatment in children. This study tests the hypothesis that the addition of fractional exhaled nitric oxide (FENO) monitoring in addition to standard care reduces the number of exacerbations (or attacks) in children with asthma. Methods This is a multi-centre, randomised controlled study. Children will be included of age 6–16 years who have a diagnosis of asthma, currently use inhaled corticosteroids (ICSs) and have had an exacerbation in the previous 12 months. Exclusion criteria include being unable to provide FENO measurement at baseline assessment, having another chronic respiratory condition and being currently treated with maintenance oral steroids. Participants will be recruited in both primary and secondary care settings and will be randomised to either receive asthma treatment guided by FENO plus symptoms (FENO group) or asthma treatment guided by symptoms only (standard care group). Within the FENO group, different treatment decisions will be made dependent on changes in FENO. Participants will attend assessments 3, 6, 9 and 12 months post randomisation. The primary outcome is asthma exacerbation requiring prescription and/or use of an oral corticosteroid over 12 months as recorded by the participant/parent or in general practitioner records. Secondary outcomes include time to first attack, number of attacks, asthma control score and quality of life. Adherence to ICS treatment is objectively measured by an electronic logging device. Participants are invited to participate in a “phenotyping” assessment where skin prick reactivity and bronchodilator response are determined and a saliva sample is collected for DNA extraction. Qualitative interviews will be held with participants and research nurses. A health economic evaluation will take place. Discussion This study will evaluate whether FENO can provide an objective index to guide and stratify asthma treatment in children. Trial registration ISRCTN, ISRCTN67875351. Registered on 12 April 2017. Prospectively registered.
                Bookmark

                Author and article information

                Contributors
                streweek@mac.com
                Journal
                Trials
                Trials
                Trials
                BioMed Central (London )
                1745-6215
                28 November 2019
                28 November 2019
                2019
                : 20
                : 649
                Affiliations
                ISNI 0000 0004 1936 7291, GRID grid.7107.1, Health Services Research Unit, , University of Aberdeen, ; Health Sciences Building, Foresterhill, Aberdeen, AB25 2ZD UK
                Article
                3865
                10.1186/s13063-019-3865-7
                6883621
                31779685
                52b3d3cc-9ddf-4e10-98f0-ec9da12babff
                © The Author(s). 2019

                Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License ( http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

                History
                Categories
                Editorial
                Custom metadata
                © The Author(s) 2019

                Medicine
                Medicine

                Comments

                Comment on this article