Improving the reporting and conduct of narrative synthesis of quantitative data (ICONS-Quant): a pilot of the ICONS-Quant tool

Article type
Authors
Thomson H1, Campbell M2, McKenzie J3, Katikireddi SV4, Sowden A5
1Cochrane Public Health, University of Glasgow
2MRC/CSO SPHSU, University of Glasgow
3Monash University
4University of Glasgow
5University of York
Abstract
Background:
Narrative synthesis (NS) of quantitative data is a common method in systematic reviews. In Cochrane Reviews, 51% include NS and 16% rely wholly on NS. However, lack of clarity around methods and transparency may raise concerns about bias in review conclusions based on NS. The ICONS-Quant (Improving the Conduct and reporting Of Narrative Synthesis of Quantitative data) project, funded by the Cochrane Strategic Methods Fund, aims to improve the transparency and reliability of NS. To achieve this we are developing tools to support authors and review users in implementing and assessing NS; this includes development of consensus-based reporting guidelines, using a Delphi survey, and development of accompanying guidance for NS. The Delphi survey started in January 2018 and a draft of the reporting items will be available in August 2018.

Objectives:
To introduce the ICONS-Quant reporting guidelines. To gather feedback on the ICONS-Quant reporting guidelines. To test comprehension of selected examples for use in the ICONS-Quant accompanying guidance on NS.

Description:
We will present an overview of the ICONS-Quant project and describe how the reporting guidelines were developed. This will include findings from a detailed data extraction exercise to establish current practice in Cochrane Reviews that have used NS. Specific elements of good practice examined include: reporting of methods; management and investigation of heterogeneity; transparency of links between the data and the narrative; and reflections on the limitations of the synthesis. The draft ICONS-Quant reporting guideline items will be presented along with examples from Cochrane Reviews to illustrate good reporting practice for each item.

Using small group work, participants will be asked to provide feedback on the ICONS-Quant reporting guidelines and the individual items. Specifically, participants will be asked to consider the level of comprehension of the guidelines and the selected illustrative examples, as well as the feasibility of implementing the guidelines in future Cochrane Reviews. The feedback from this workshop will be taken to the final expert panel meeting where the reporting guideline items will be finalised in September 2018.