Informing the methods for public health overview reviews: a descriptive analysis of Cochrane and non-Cochrane public health overviews

Article type
Authors
James B1, Baker P1, Costello J1, Francis D1
1Cochrane Public Health, Queensland University of Technology, Australia
Abstract
Background:
Overviews of systematic reviews (SRs) are useful for public health policy; however there is an absence of Cochrane Overviews covering public health (PH) topics.

Objectives:
We sought to analyze the methodological approaches used in existing Cochrane Overviews and Protocols for overviews (primarily clinical in nature), and compare these to the methods and approaches used in PH overviews (non-Cochrane). The intent was to identify issues that would be relevant for undertaking Cochrane PH overviews.

Methods: We conducted a descriptive analysis of overviews published between 1999 and 2014. We searched the Cochrane Database of Systematic Reviews for Cochrane Protocols for overviews and Cochrane Overviews, and the HealthEvidence.org for PH overviews. The primary characteristics of the overviews and elements of the methodology were extracted and compared.

Results:
A total of 61 overviews of SRs were included in our analysis; specifically, this included 21 Cochrane Protocols for overviews, 15 Cochrane Overviews, and 27 non-Cochrane PH overviews. Amongst the overviews, the most significant differences are that PH overviews (non-Cochrane) tend to: include earlier and more reviews, greater number of participants, allow lower levels of evidence, use assessment tools other than AMSTAR (A Measurement Tool to Assess Systematic Reviews, i.e. a tool for assessing quality of SRs), not assess quality of evidence in reviews, search more databases overall, specify search limits including English-only reviews, and not consider recent primary studies for inclusion. Some of these differences clearly related to quality, however many relate to the nuances of PH interventions.

Conclusions:
The methodology in Cochrane overviews and PH overviews varies widely. Future PH overviews may benefit from the Cochrane methodology but the Cochrane approach requires modification to accommodate PH research methodology. Additionally, the use of databases that pre-screen and quality assess relevant PH systematic reviews may help expedite the search process.