Article type
Abstract
Background: Systematic reviews often address complex interventions that have multiple components. Standard meta-analysis methods often do not adequately reflect the complexity of these interventions because compromises must be made to facilitate synthesis (e.g. multiarm studies are reduced to single-pairwise comparisons and only components that differ between arms are modelled in the observed difference of effect). As a result, the meta-analysis fails to include all available data and cannot isolate the effects of components that may be of interest to decision makers.
Objectives: To explore the utility of hierarchical meta-regression models in a meta-analysis of complex QI interventions for diabetes.
Methods: Systematic review of QI programmes for diabetes that included at least one of 12 QI strategies. We implemented a series of hierarchical models to assess the effects of QI strategies. We explored extensions of the models to evaluate interactions among QI components and with contextual and programme-level covariates. Finally, we used the models to predict the combined effects of QI strategies previously not evaluated in the same QI programme while accounting for other features of the available data (e.g. large number of cluster randomised trials with missing data on the intra-class correlation coefficient).
Results: We included 278 RCTs. Hierarchical meta-regression models estimated effects of individual QI components, producing different rankings compared to standard methods. For example, while the 3 QI strategies Promotion of Self Management (PSM), Team Changes (TC), and Case Management remained the most effective strategies for reducing glycated haemoglobin, the effects of each strategy were smaller (presumably due to the better isolation of their individual contributions) and TC emerged above PSM as most effective. The models allowed the assessment of interactions and effect modification; model selection is ongoing and additional results will be presented at the Summit.
Conclusions: Background knowledge combined with flexible synthesis models can allow fuller use of available data in reviews of complex interventions such as QI programmes.
Objectives: To explore the utility of hierarchical meta-regression models in a meta-analysis of complex QI interventions for diabetes.
Methods: Systematic review of QI programmes for diabetes that included at least one of 12 QI strategies. We implemented a series of hierarchical models to assess the effects of QI strategies. We explored extensions of the models to evaluate interactions among QI components and with contextual and programme-level covariates. Finally, we used the models to predict the combined effects of QI strategies previously not evaluated in the same QI programme while accounting for other features of the available data (e.g. large number of cluster randomised trials with missing data on the intra-class correlation coefficient).
Results: We included 278 RCTs. Hierarchical meta-regression models estimated effects of individual QI components, producing different rankings compared to standard methods. For example, while the 3 QI strategies Promotion of Self Management (PSM), Team Changes (TC), and Case Management remained the most effective strategies for reducing glycated haemoglobin, the effects of each strategy were smaller (presumably due to the better isolation of their individual contributions) and TC emerged above PSM as most effective. The models allowed the assessment of interactions and effect modification; model selection is ongoing and additional results will be presented at the Summit.
Conclusions: Background knowledge combined with flexible synthesis models can allow fuller use of available data in reviews of complex interventions such as QI programmes.