13
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Methods, Applications and Challenges in the Analysis of Interrupted Time Series Data: A Scoping Review

      review-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Objective

          Interrupted time series (ITS) designs are robust quasi-experimental designs commonly used to evaluate the impact of interventions and programs implemented in healthcare settings. This scoping review aims to 1) identify and summarize existing methods used in the analysis of ITS studies conducted in health research, 2) elucidate their strengths and limitations, 3) describe their applications in health research and 4) identify any methodological gaps and challenges.

          Design

          Scoping review.

          Data Sources

          Searches were conducted in MEDLINE, JSTOR, PUBMED, EMBASE, CINAHL, Web of Science and the Cochrane Library from inception until September 2017.

          Study Selection

          Studies in health research involving ITS methods or reporting on the application of ITS designs.

          Data Extraction

          Screening of studies was completed independently and in duplicate by two reviewers. One reviewer extracted the data from relevant studies in consultations with a second reviewer. Results of the review were presented with respect to methodological and application areas, and data were summarized using descriptive statistics.

          Results

          A total of 1389 articles were included, of which 98.27% (N=1365) were application papers. Segmented linear regression was the most commonly used method (26%, N=360). A small percentage (1.73%, N=24) were methods papers, of which 11 described either the development of novel methods or improvement of existing methods, 7 adapted methods from other areas of statistics, while 6 provided comparative assessment of conventional ITS methods.

          Conclusion

          A significantly increasing trend in ITS use over time is observed, where its application in health research almost tripled within the last decade. Several statistical methods are available for analyzing ITS data. Researchers should consider the types of data and validate the required assumptions for the various methods. There is a significant methodological gap in ITS analysis involving aggregated data, where analyses involving such data did not account for heterogeneity across patients and hospital settings.

          Related collections

          Most cited references38

          • Record: found
          • Abstract: found
          • Article: not found

          Guidance for conducting systematic scoping reviews.

          Reviews of primary research are becoming more common as evidence-based practice gains recognition as the benchmark for care, and the number of, and access to, primary research sources has grown. One of the newer review types is the 'scoping review'. In general, scoping reviews are commonly used for 'reconnaissance' - to clarify working definitions and conceptual boundaries of a topic or field. Scoping reviews are therefore particularly useful when a body of literature has not yet been comprehensively reviewed, or exhibits a complex or heterogeneous nature not amenable to a more precise systematic review of the evidence. While scoping reviews may be conducted to determine the value and probable scope of a full systematic review, they may also be undertaken as exercises in and of themselves to summarize and disseminate research findings, to identify research gaps, and to make recommendations for the future research. This article briefly introduces the reader to scoping reviews, how they are different to systematic reviews, and why they might be conducted. The methodology and guidance for the conduct of systematic scoping reviews outlined below was developed by members of the Joanna Briggs Institute and members of five Joanna Briggs Collaborating Centres.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: found
            Is Open Access

            Interrupted time series regression for the evaluation of public health interventions: a tutorial

            Abstract Interrupted time series (ITS) analysis is a valuable study design for evaluating the effectiveness of population-level health interventions that have been implemented at a clearly defined point in time. It is increasingly being used to evaluate the effectiveness of interventions ranging from clinical therapy to national public health legislation. Whereas the design shares many properties of regression-based approaches in other epidemiological studies, there are a range of unique features of time series data that require additional methodological considerations. In this tutorial we use a worked example to demonstrate a robust approach to ITS analysis using segmented regression. We begin by describing the design and considering when ITS is an appropriate design choice. We then discuss the essential, yet often omitted, step of proposing the impact model a priori. Subsequently, we demonstrate the approach to statistical analysis including the main segmented regression model. Finally we describe the main methodological issues associated with ITS analysis: over-dispersion of time series data, autocorrelation, adjusting for seasonal trends and controlling for time-varying confounders, and we also outline some of the more complex design adaptations that can be used to strengthen the basic ITS design.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Interrupted time series designs in health technology assessment: lessons from two systematic reviews of behavior change strategies.

              In an interrupted time series (ITS) design, data are collected at multiple instances over time before and after an intervention to detect whether the intervention has an effect significantly greater than the underlying secular trend. We critically reviewed the methodological quality of ITS designs using studies included in two systematic reviews (a review of mass media interventions and a review of guideline dissemination and implementation strategies). Quality criteria were developed, and data were abstracted from each study. If the primary study analyzed the ITS design inappropriately, we reanalyzed the results by using time series regression. Twenty mass media studies and thirty-eight guideline studies were included. A total of 66% of ITS studies did not rule out the threat that another event could have occurred at the point of intervention. Thirty-three studies were reanalyzed, of which eight had significant preintervention trends. All of the studies were considered "effective" in the original report, but approximately half of the reanalyzed studies showed no statistically significant differences. We demonstrated that ITS designs are often analyzed inappropriately, underpowered, and poorly reported in implementation research. We have illustrated a framework for appraising ITS designs, and more widespread adoption of this framework would strengthen reviews that use ITS designs.
                Bookmark

                Author and article information

                Journal
                J Multidiscip Healthc
                J Multidiscip Healthc
                JMDH
                jmulthealth
                Journal of Multidisciplinary Healthcare
                Dove
                1178-2390
                13 May 2020
                2020
                : 13
                : 411-423
                Affiliations
                [1 ]Department of Health Research Methods, Evidence, and Impact, McMaster University , Hamilton, Ontario, Canada
                [2 ]Li Ka Shing Knowledge Institute of St Michael’s Hospital , Toronto, Ontario, Canada
                [3 ]Institute of Health Policy Management and Evaluation (IHPME), University of Toronto , Toronto, ON, Canada
                [4 ]Biostatistics Unit, Father Sean O’Sullivan Research Centre, St Joseph’s Healthcare , Hamilton, Ontario, Canada
                [5 ]Clinical Research Unit, Children’s Hospital of Eastern Ontario , Ottawa, ON, Canada
                Author notes
                Correspondence: Jemila S Hamid Children’s Hospital of Eastern Ontario , 401 Smyth Road, Ottawa, ONK1H 8L1, CanadaTel +1 (613) 737-7600 x 4194 Email jhamid@uottawa.ca
                Author information
                http://orcid.org/0000-0003-4292-1134
                http://orcid.org/0000-0002-2271-3082
                Article
                241085
                10.2147/JMDH.S241085
                7231782
                32494150
                328a414c-9c84-4da3-a957-3f2654745688
                © 2020 Ewusie et al.

                This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution – Non Commercial (unported, v3.0) License ( http://creativecommons.org/licenses/by-nc/3.0/). By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms ( https://www.dovepress.com/terms.php).

                History
                : 04 December 2019
                : 17 April 2020
                Page count
                Figures: 2, Tables: 1, References: 51, Pages: 13
                Categories
                Review

                Medicine
                interrupted time series,segmented linear regression,arima,limitations,methods,scoping review
                Medicine
                interrupted time series, segmented linear regression, arima, limitations, methods, scoping review

                Comments

                Comment on this article