9
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      SWATted away: the challenging experience of setting up a programme of SWATs in paediatric trials

      letter

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Background

          Randomised controlled trials are considered the best method for determining the effectiveness and safety of health interventions. Trials involving children are essential to ensure that treatments are safe and effective. However, many trials, in both adult and paediatric populations, do not achieve recruitment targets and/or maintain retention of participants, which can lead to a reduction in the internal and external validity of the results. Identifying ways of improving trial efficiency are important in order to increase the successful completion of trials.

          Main body

          A ‘Study Within A Trial’ (SWAT) is a self-contained study embedded within an ongoing trial, which aims to establish evidence to improve the management and delivery of trials in healthcare. Increasing numbers of SWATs have been undertaken in recent years yet very few within paediatric trials. Herein, we describe some of the challenges with undertaking a programme of SWATs within paediatric clinical trials in the UK. The TRECA (TRials Engagement in Children and Adolescents) study involves developing multimedia websites for use within paediatric trials to provide recruitment information to children, young people and their families about the clinical trial. Challenges encountered included governance issues such as host trial approval processes and sharing of anonymised data, funding issues for host trials, internet quality and accessibility within the healthcare setting, and ethical concerns associated with SWAT methodology. We believe the ethical concerns are more pronounced in the paediatric setting, perhaps because of the fewer SWATs undertaken in these settings or that a more cautious, risk-averse approach to undertaking research with children is taken.

          Conclusion

          SWATs are becoming increasingly common to provide an evidence base for methods to improve trial efficiency. However, we encountered a number of unanticipated challenges to embedding TRECA that have not been previously reported within the scientific literature. We believe that, if these issues were addressed through wider promotion and explanation of undertaking SWATs involving all key stakeholders, as well as by exploration of alternative funding models for SWATs, this would enable more streamlined, appropriate and timely processes for SWATs and a stronger evidence base for what works to increase trial efficiency.

          Trial registration

          The TRECA study is registered on ISRCTN, ID 73136092. Registered on 24 August 2016.

          Related collections

          Most cited references11

          • Record: found
          • Abstract: found
          • Article: not found

          Strategies to improve recruitment to randomised trials

          Recruiting participants to trials can be extremely difficult. Identifying strategies that improve trial recruitment would benefit both trialists and health research. To quantify the effects of strategies for improving recruitment of participants to randomised trials. A secondary objective is to assess the evidence for the effect of the research setting (e.g. primary care versus secondary care) on recruitment. We searched the Cochrane Methodology Review Group Specialised Register (CMR) in the Cochrane Library (July 2012, searched 11 February 2015); MEDLINE and MEDLINE In Process (OVID) (1946 to 10 February 2015); Embase (OVID) (1996 to 2015 Week 06); Science Citation Index & Social Science Citation Index (ISI) (2009 to 11 February 2015) and ERIC (EBSCO) (2009 to 11 February 2015). Randomised and quasi‐randomised trials of methods to increase recruitment to randomised trials. This includes non‐healthcare studies and studies recruiting to hypothetical trials. We excluded studies aiming to increase response rates to questionnaires or trial retention and those evaluating incentives and disincentives for clinicians to recruit participants. We extracted data on: the method evaluated; country in which the study was carried out; nature of the population; nature of the study setting; nature of the study to be recruited into; randomisation or quasi‐randomisation method; and numbers and proportions in each intervention group. We used a risk difference to estimate the absolute improvement and the 95% confidence interval (CI) to describe the effect in individual trials. We assessed heterogeneity between trial results. We used GRADE to judge the certainty we had in the evidence coming from each comparison. We identified 68 eligible trials (24 new to this update) with more than 74,000 participants. There were 63 studies involving interventions aimed directly at trial participants, while five evaluated interventions aimed at people recruiting participants. All studies were in health care. We found 72 comparisons, but just three are supported by high‐certainty evidence according to GRADE. 1. Open trials rather than blinded, placebo trials . The absolute improvement was 10% (95% CI 7% to 13%). 2. Telephone reminders to people who do not respond to a postal invitation . The absolute improvement was 6% (95% CI 3% to 9%). This result applies to trials that have low underlying recruitment. We are less certain for trials that start out with moderately good recruitment (i.e. over 10%). 3. Using a particular, bespoke, user‐testing approach to develop participant information leaflets . This method involved spending a lot of time working with the target population for recruitment to decide on the content, format and appearance of the participant information leaflet. This made little or no difference to recruitment: absolute improvement was 1% (95% CI −1% to 3%). We had moderate‐certainty evidence for eight other comparisons; our confidence was reduced for most of these because the results came from a single study. Three of the methods were changes to trial management, three were changes to how potential participants received information, one was aimed at recruiters, and the last was a test of financial incentives. All of these comparisons would benefit from other researchers replicating the evaluation. There were no evaluations in paediatric trials. We had much less confidence in the other 61 comparisons because the studies had design flaws, were single studies, had very uncertain results or were hypothetical (mock) trials rather than real ones. The literature on interventions to improve recruitment to trials has plenty of variety but little depth. Only 3 of 72 comparisons are supported by high‐certainty evidence according to GRADE: having an open trial and using telephone reminders to non‐responders to postal interventions both increase recruitment; a specialised way of developing participant information leaflets had little or no effect. The methodology research community should improve the evidence base by replicating evaluations of existing strategies, rather than developing and testing new ones. What improves trial recruitment? Key messages We had high‐certainty evidence for three methods to improve recruitment, two of which are effective: 1. Telling people what they are receiving in the trial rather than not telling them improves recruitment. 2. Phoning people who do not respond to a postal invitation is also effective (although we are not certain this works as well in all trials). 3. Using a tailored, user‐testing approach to develop participant information leaflets makes little or no difference to recruitment. Of the 72 strategies tested, only 7 involved more than one study. We need more studies to understand whether they work or not. Our question We reviewed the evidence about the effect of things trial teams do to try and improve recruitment to their trials. We found 68 studies involving more than 74,000 people. Background Finding participants for trials can be difficult, and trial teams try many things to improve recruitment. It is important to know whether these actually work. Our review looked for studies that examined this question using chance to allocate people to different recruitment strategies because this is the fairest way of seeing if one approach is better than another. Key results We found 68 studies including 72 comparisons. We have high certainty in what we found for only three of these. 1. Telling people what they are receiving in the trial rather than not telling them improves recruitment. Our best estimate is that if 100 people were told what they were receiving in a randomised trial, and 100 people were not, 10 more would take part n the group who knew. There is some uncertainty though: it could be as few as 7 more per hundred, or as many as 13 more. 2. Phoning people who do not respond to a postal invitation to take part is also effective. Our best estimate is that if investigators called 100 people who did not respond to a postal invitation, and did not call 100 others, 6 more would take part in the trial among the group who received a call. However, this number could be as few as 3 more per hundred, or as many as 9 more. 3. Using a tailored, user‐testing approach to develop participant information leaflets did not make much difference. The researchers who tested this method spent a lot of time working with people like those to be recruited to decide what should be in the participant information leaflet and what it should look like. Our best estimate is that if 100 people got the new leaflet, 1 more would take part in the trial compared to 100 who got the old leaflet. However, there is some uncertainty, and it could be 1 fewer (i.e. worse than the old leaflet) per hundred, or as many as 3 more. We had moderate certainty in what we found for eight other comparisons; our confidence was reduced for most of these because the method had been tested in only one study. We had much less confidence in the other 61 comparisons because the studies had design flaws, were the only studies to look at a particular method, had a very uncertain result or were mock trials rather than real ones. Study characteristics The 68 included studies covered a very wide range of disease areas, including antenatal care, cancer, home safety, hypertension, podiatry, smoking cessation and surgery. Primary, secondary and community care were included. The size of the studies ranged from 15 to 14,467 participants. Studies came from 12 countries; there was also one multinational study involving 19 countries. The USA and UK dominated with 25 and 22 studies, respectively. The next largest contribution came from Australia with eight studies. The small print Our search updated our 2010 review and is current to February 2015. We also identified six studies published after 2015 outside the search. The review includes 24 mock trials where the researchers asked people about whether they would take part in an imaginary trial. We have not presented or discussed their results because it is hard to see how the findings relate to real trial decisions.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Increasing value and reducing waste in biomedical research: who's listening?

            The biomedical research complex has been estimated to consume almost a quarter of a trillion US dollars every year. Unfortunately, evidence suggests that a high proportion of this sum is avoidably wasted. In 2014, The Lancet published a series of five reviews showing how dividends from the investment in research might be increased from the relevance and priorities of the questions being asked, to how the research is designed, conducted, and reported. 17 recommendations were addressed to five main stakeholders-funders, regulators, journals, academic institutions, and researchers. This Review provides some initial observations on the possible effects of the Series, which seems to have provoked several important discussions and is on the agendas of several key players. Some examples of individual initiatives show ways to reduce waste and increase value in biomedical research. This momentum will probably move strongly across stakeholder groups, if collaborative relationships evolve between key players; further important work is needed to increase research value. A forthcoming meeting in Edinburgh, UK, will provide an initial forum within which to foster the collaboration needed.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: found
              Is Open Access

              Systematic techniques for assisting recruitment to trials (START): study protocol for embedded, randomized controlled trials

              Background Randomized controlled trials play a central role in evidence-based practice, but recruitment of participants, and retention of them once in the trial, is challenging. Moreover, there is a dearth of evidence that research teams can use to inform the development of their recruitment and retention strategies. As with other healthcare initiatives, the fairest test of the effectiveness of a recruitment strategy is a trial comparing alternatives, which for recruitment would mean embedding a recruitment trial within an ongoing host trial. Systematic reviews indicate that such studies are rare. Embedded trials are largely delivered in an ad hoc way, with interventions almost always developed in isolation and tested in the context of a single host trial, limiting their ability to contribute to a body of evidence with regard to a single recruitment intervention and to researchers working in different contexts. Methods/Design The Systematic Techniques for Assisting Recruitment to Trials (START) program is funded by the United Kingdom Medical Research Council (MRC) Methodology Research Programme to support the routine adoption of embedded trials to test standardized recruitment interventions across ongoing host trials. To achieve this aim, the program involves three interrelated work packages: (1) methodology - to develop guidelines for the design, analysis and reporting of embedded recruitment studies; (2) interventions - to develop effective and useful recruitment interventions; and (3) implementation - to recruit host trials and test interventions through embedded studies. Discussion Successful completion of the START program will provide a model for a platform for the wider trials community to use to evaluate recruitment interventions or, potentially, other types of intervention linked to trial conduct. It will also increase the evidence base for two types of recruitment intervention. Trial registration The START protocol covers the methodology for embedded trials. Each embedded trial is registered separately or as a substudy of the host trial.
                Bookmark

                Author and article information

                Contributors
                jackie.martin-kerry@york.ac.uk
                adwoa.parker@york.ac.uk
                peter.bower@manchester.ac.uk
                ian.watt@york.ac.uk
                streweek@mac.com
                david.torgerson@york.ac.uk
                catherine.arundel@york.ac.uk
                peter.knapp@york.ac.uk
                Journal
                Trials
                Trials
                Trials
                BioMed Central (London )
                1745-6215
                19 February 2019
                19 February 2019
                2019
                : 20
                : 141
                Affiliations
                [1 ]ISNI 0000 0004 1936 9668, GRID grid.5685.e, Department of Health Sciences, , University of York, ; Heslington, York, YO10 5DD UK
                [2 ]ISNI 0000000121662407, GRID grid.5379.8, MRC North West Hub for Trials Methodology Research, NIHR School for Primary Care Research, , University of Manchester, ; Manchester, M13 9PL UK
                [3 ]ISNI 0000 0004 1936 9668, GRID grid.5685.e, Department of Health Sciences and the Hull York Medical School, , University of York, ; Heslington, York, YO10 5DD UK
                [4 ]ISNI 0000 0004 1936 7291, GRID grid.7107.1, Health Services Research Unit, , University of Aberdeen, ; Foresterhill, Aberdeen, AB25 2ZD UK
                Author information
                http://orcid.org/0000-0002-9299-1360
                Article
                3236
                10.1186/s13063-019-3236-4
                6381684
                30782209
                2b6f3d2d-2f18-46f7-9c16-33782c4db511
                © The Author(s). 2019

                Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License ( http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

                History
                : 31 July 2018
                : 31 January 2019
                Funding
                Funded by: FundRef http://dx.doi.org/10.13039/501100002001, Health Services and Delivery Research Programme;
                Award ID: 14/21/21
                Award Recipient :
                Categories
                Commentary
                Custom metadata
                © The Author(s) 2019

                Medicine
                ‘sstudy within a trial’ (swat),embedded trials,methodology,challenges,randomised controlled trials,paediatrics,governance

                Comments

                Comment on this article