25
views
0
recommends
+1 Recommend
1 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Network meta-analysis: a technique to gather evidence from direct and indirect comparisons

      research-article

      Read this article at

      ScienceOpenPublisherPMC
      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Systematic reviews and pairwise meta-analyses of randomized controlled trials, at the intersection of clinical medicine, epidemiology and statistics, are positioned at the top of evidence-based practice hierarchy. These are important tools to base drugs approval, clinical protocols and guidelines formulation and for decision-making. However, this traditional technique only partially yield information that clinicians, patients and policy-makers need to make informed decisions, since it usually compares only two interventions at the time. In the market, regardless the clinical condition under evaluation, usually many interventions are available and few of them have been studied in head-to-head studies. This scenario precludes conclusions to be drawn from comparisons of all interventions profile (e.g. efficacy and safety). The recent development and introduction of a new technique – usually referred as network meta-analysis, indirect meta-analysis, multiple or mixed treatment comparisons – has allowed the estimation of metrics for all possible comparisons in the same model, simultaneously gathering direct and indirect evidence. Over the last years this statistical tool has matured as technique with models available for all types of raw data, producing different pooled effect measures, using both Frequentist and Bayesian frameworks, with different software packages. However, the conduction, report and interpretation of network meta-analysis still poses multiple challenges that should be carefully considered, especially because this technique inherits all assumptions from pairwise meta-analysis but with increased complexity. Thus, we aim to provide a basic explanation of network meta-analysis conduction, highlighting its risks and benefits for evidence-based practice, including information on statistical methods evolution, assumptions and steps for performing the analysis.

          Related collections

          Most cited references45

          • Record: found
          • Abstract: found
          • Article: not found

          The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials.

          When little or no data directly comparing two treatments are available, investigators often rely on indirect comparisons from studies testing the treatments against a control or placebo. One approach to indirect comparison is to pool findings from the active treatment arms of the original controlled trials. This approach offers no advantage over a comparison of observational study data and is prone to bias. We present an alternative model that evaluates the differences between treatment and placebo in two sets of clinical trials, and preserves the randomization of the originally assigned patient groups. We apply the method to data on sulphamethoxazole-trimethoprim or dapsone/pyrimethamine as prophylaxis against Pneumocystis carinii in HIV infected patients. The indirect comparison showed substantial increased benefit from the former (odds ratio 0.37, 95% CI 0.21 to 0.65), while direct comparisons from randomized trials suggests a much smaller difference (risk ratio 0.64, 95% CI 0.45 to 0.90; p-value for difference of effect = 0.11). Direct comparisons of treatments should be sought. When direct comparisons are unavailable, indirect comparison meta-analysis should evaluate the magnitude of treatment effects across studies, recognizing the limited strength of inference.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Evaluation of inconsistency in networks of interventions.

            The assumption of consistency, defined as agreement between direct and indirect sources of evidence, underlies the increasingly popular method of network meta-analysis. No evidence exists so far regarding the extent of inconsistency in full networks of interventions or the factors that control its statistical detection. In this paper we assess the prevalence of inconsistency from data of 40 published networks of interventions involving 303 loops of evidence. Inconsistency is evaluated in each loop by contrasting direct and indirect estimates and by employing an omnibus test of consistency for the entire network. We explore whether different effect measures for dichotomous outcomes are associated with differences in inconsistency, and evaluate whether different ways to estimate heterogeneity affect the magnitude and detection of inconsistency. Inconsistency was detected in from 2% to 9% of the tested loops, depending on the effect measure and heterogeneity estimation method. Loops that included comparisons informed by a single study were more likely to show inconsistency. About one-eighth of the networks were found to be inconsistent. The proportions of inconsistent loops do not materially change when different effect measures are used. Important heterogeneity or the overestimation of heterogeneity was associated with a small decrease in the prevalence of statistical inconsistency. The study suggests that changing the effect measure might improve statistical consistency, and that an analysis of sensitivity to the assumptions and an estimator of heterogeneity might be needed before reaching a conclusion about the absence of statistical inconsistency, particularly in networks with few studies.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: found
              Is Open Access

              Is network meta-analysis as valid as standard pairwise meta-analysis? It all depends on the distribution of effect modifiers

              Background In the last decade, network meta-analysis of randomized controlled trials has been introduced as an extension of pairwise meta-analysis. The advantage of network meta-analysis over standard pairwise meta-analysis is that it facilitates indirect comparisons of multiple interventions that have not been studied in a head-to-head fashion. Although assumptions underlying pairwise meta-analyses are well understood, those concerning network meta-analyses are perceived to be more complex and prone to misinterpretation. Discussion In this paper, we aim to provide a basic explanation when network meta-analysis is as valid as pairwise meta-analysis. We focus on the primary role of effect modifiers, which are study and patient characteristics associated with treatment effects. Because network meta-analysis includes different trials comparing different interventions, the distribution of effect modifiers cannot only vary across studies for a particular comparison (as with standard pairwise meta-analysis, causing heterogeneity), but also between comparisons (causing inconsistency). If there is an imbalance in the distribution of effect modifiers between different types of direct comparisons, the related indirect comparisons will be biased. If it can be assumed that this is not the case, network meta-analysis is as valid as pairwise meta-analysis. Summary The validity of network meta-analysis is based on the underlying assumption that there is no imbalance in the distribution of effect modifiers across the different types of direct treatment comparisons, regardless of the structure of the evidence network.
                Bookmark

                Author and article information

                Contributors
                Journal
                Pharm Pract (Granada)
                Pharm Pract (Granada)
                Pharmacy Practice
                Centro de Investigaciones y Publicaciones Farmaceuticas
                1885-642X
                1886-3655
                Jan-Mar 2017
                15 March 2017
                : 15
                : 1
                : 943
                Affiliations
                MSc. (Pharm). Pharmaceutical Sciences Postgraduate Programme, Federal University of Paraná . Curitiba (Brazil). stumpf.tonin@ 123456ufpr.br
                PhD. Pharmacy Service, Hospital de Clínicas, Federal University of Paraná . Curitiba (Brazil). inarotta@ 123456gmail.com
                MSc. (Pharm). Pharmaceutical Sciences Postgraduate Programme, Federal University of Paraná . Curitiba (Brazil). mmendesantonio@ 123456gmail.com
                PhD. Department of Pharmacy, Federal University of Paraná . Curitiba (Brazil). pontarolo@ 123456ufpr.br
                Author information
                http://orcid.org/0000-0003-4262-8608
                http://orcid.org/0000-0002-9099-7216
                http://orcid.org/0000-0002-5752-349X
                http://orcid.org/0000-0002-7049-4363
                Article
                pharmpract-15-943
                10.18549/PharmPract.2017.01.943
                5386629
                28503228
                979de595-8d63-43ac-a327-dd4da18b70cb
                Copyright: © 2017 Pharmacy Practice and The Authors

                This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY-NC-ND 3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

                History
                : 13 February 2017
                : 07 March 2017
                Funding
                Funded by: Brazilian National Council of Scientific Research (CNPq)
                Funded by: Coordination for the Improvement of Higher Education Personnel (CAPES)
                This work was supported by the Brazilian National Council of Scientific Research (CNPq) and the Coordination for the Improvement of Higher Education Personnel (CAPES).
                Categories
                Review

                network meta-analysis,evidence-based practice,treatment outcome,decision support techniques

                Comments

                Comment on this article