Alternative strategy to identify systematic reviews in the context of a guideline

Article type
Authors
Rada G1, Bravo-Soto GA2, Castro-Gutiérrez V2, Couban R3, Etxeandia I3, Llovet V2, Lobos D2, Schunemann H3, Wiercioch W3, Zhang Y3, Neumann I1
1Epistemonikos foundation; Centro Evidencia UC, Pontificia Universidad Católica de Chile.
2Epistemonikos foundation
3McMaster University, Hamilton, Ontario
Abstract
Background: Searching for existing systematic reviews is a key step in the development of most guidelines, but retrieving all relevant reviews involves substantial work. In the context of the venous thromboembolism (VTE) guidelines of the American Society of Hematology we compared two different approaches.

Objectives: To compare a traditional search approach to an alternative approach using Epistemonikos database (www.epistemonikos.org) to identify systematic reviews relevant for a guideline.

Methods: We selected all of the questions (n=27) from one guideline (VTE treatment). The traditional approach included searches in MEDLINE, EMBASE and Cochrane, using a filter adapted from several sources (SIGN filters, KSA guidelines, NICE 144) plus filters to identify records relevant for VTE. The same terms for VTE were adapted to Epistemonikos syntaxis for the alternative approach. For both approaches, at least two researchers screened records. In the traditional approach potentially eligible articles were evaluated in full text for inclusion. In the alternative approach one review per question (index review) was selected, and reviews that shared at least one included study were evaluated for inclusion. The final reference selection was done by the chapter methodologist for both approaches. We calculated recall (included reviews/reviews identified by any approach) and search efficiency (included reviews/ initial number of records).

Results: Traditional approach returned 7678 citations, 159 full texts were retrieved, and 38 reviews were finally included. Epistemonikos approach returned 4434 citations, from which 406 were pre-selected (20 index reviews selected), 153 full texts were retrieved, and 94 were finally included.
Recall was 39.6% (38/96) for traditional approach vs. 97.9% for alternative. Search efficiency was 0.0049 (38/7678) for traditional approach and 0.0211 for alternative (94/4434).

Conclusions: An alternative approach using Epistemonikos database was more sensitive and efficient than the traditional approach. These conclusions have important implications for improving efficiency and feasibility of guidelines, but need further validation.