Article type
Abstract
Background: Systematic reviews offer the most reliable and valid support for health-policy decision making, patient information and guideline development. However, they often do not meet the needs of those who have to make decisions quickly. Rapid reviews have therefore become a pragmatic alternative to systematic reviews. They are knowledge syntheses that abbreviate certain methodological aspects of systematic reviews to produce information more quickly. Methodological shortcuts often take place in literature identification. Potential disadvantages are less-reliable results. To date, the impact of abbreviated searches on estimates of treatment effects and subsequent conclusions has not been analysed systematically across multiple bodies of evidence.
Objectives: We aim to assess whether bodies of evidence that are based on abbreviated literature searches lead to different conclusions about benefits and harms of interventions compared with bodies of evidence that are based on comprehensive, systematic literature searches.
Methods: We used a non-inferiority design with the primary outcome: proportion of discordant conclusions based on different search approaches. We randomly chose 60 Cochrane reviews, and reproduced their MEDLINE, Embase and CENTRAL searches employing abbreviated search strategies. If abbreviated searches could not detect all studies included in the original review, we recalculated effect sizes, revised the original summary-of-findings table and asked review authors whether the missed evidence would change the conclusions of their report. We determined the proportion of discordant conclusions for each abbreviated search approach, and considered it as non-inferior if the lower limit of the 95% confidence interval of the proportion of discordant conclusions was below the non-inferiority margin, which was determined based on results of a survey for clinical and public-health scenarios.
Results: Will be available at the Summit.
Conclusions: This will be the first study to assess whether the reduced sensitivity of abbreviated searches has an impact on conclusions across multiple bodies of evidence, not only on effect estimates.
Objectives: We aim to assess whether bodies of evidence that are based on abbreviated literature searches lead to different conclusions about benefits and harms of interventions compared with bodies of evidence that are based on comprehensive, systematic literature searches.
Methods: We used a non-inferiority design with the primary outcome: proportion of discordant conclusions based on different search approaches. We randomly chose 60 Cochrane reviews, and reproduced their MEDLINE, Embase and CENTRAL searches employing abbreviated search strategies. If abbreviated searches could not detect all studies included in the original review, we recalculated effect sizes, revised the original summary-of-findings table and asked review authors whether the missed evidence would change the conclusions of their report. We determined the proportion of discordant conclusions for each abbreviated search approach, and considered it as non-inferior if the lower limit of the 95% confidence interval of the proportion of discordant conclusions was below the non-inferiority margin, which was determined based on results of a survey for clinical and public-health scenarios.
Results: Will be available at the Summit.
Conclusions: This will be the first study to assess whether the reduced sensitivity of abbreviated searches has an impact on conclusions across multiple bodies of evidence, not only on effect estimates.