Are there differences in results between Bayesian and Frequentist network meta-analyses

Article type
Authors
Ling J1, Ge L2, Tian J3, Yang K1
1Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University
21. Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China 2. Key Laboratory of Evidence-Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, China 3. First clinical medical college of Lanzhou U
31. Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China 2. Key Laboratory of Evidence-Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, China
Abstract
Background: Frequentist statistical methods rely on traditional notions of statistical significance. It is easy to include and assess the effect of the study design by adding this extra level to the hierarchy of the data structure. Nowadays, Bayesian statistical methods are increasingly popular as a tool for meta-analysis of clinical trial data involving both direct and indirect treatment comparisons. However, appropriate selection of prior distributions for unknown model parameters and checking of consistency assumptions required for feasible modeling remain particularly challenging. Besides, the consistency in network meta-analysis between Bayesian and Frequentist analysis method are unclear, there are very few papers that explicitly discuss and compare the underlying consistency of these two methods.

Objectives: The objective of this presentation is to review the differences and consistency in the network meta-analysis between Bayesian and Frequentist analysis method.

Methods: A comprehensive literature search in the Cochrane Library, PubMed, EMBASE, Chinese Biomedical Database (CBM), China National Knowledge Infrastructure (CNKI), and the Wanfang Database was conducted from inception to February, 2017. We included the network meta-analysis of randomised-controlled trials that provided sufficient data for both Bayesian and Frequentist analysis method.
We calculated the inconsistency, defined as the difference in log odds ratios between Bayesian and Frequentist analysis method estimates, together with its standard error, and tested whether the inconsistency was statistically significant. The inconsistency between Bayesian and Frequentist analysis method estimates can also be expressed as a ratio of odds ratios by an anti-log transformation. We calculated the proportion of trial networks with a statistically significant inconsistency (P