Identification of systematic reviews in LILACS

Article type
Authors
Ciapponi A1, Glujovsky D1, Aleman A2, Caccavo F3, Claro García-Atance JC4, Comandé D3, Corbalán Pössel J5, Daray FM6, Eslava Schmalbach JH7, Fernández Toricez A8, García Dieguez M9, García Martí S10, Gianneo O11, Gutiérrez Castrellón P12, Jimenerrezz Gutie C13, Klajn DS14, López L15, Loza Munarriz CA16, Malaga G17, Patrón Sentena C18, Pinto R19, Rada G20, Rey Ares L3, Rivera Mercado S21, Rodriguez Funes V22, Rodriguez R23, Sguassero Y24, Tisi Baña M25, Abdala V19
1IECS—Institute for Clinical Effectiveness and Health Policy, Argentina
2Departamento de Medicina Preventiva y Social, Facultad de Medicina. Universidad de la Republica, Uruguay
3Argentine Cochrane Centre IECS, Institute for Clinical Effectiveness and Health Policy. Buenos Aires, Argentina
4EBM Unit, Faculty of Medicine, Pontificia Universidad Catolica de Chile, Chile
5Health Policy and Systems Research Unit, Pontificia Universidad Catolica de Chile, Chile
63 ◦ Cátedra de Farmacologia, Facultad de Medicina, UBA. Consejo Nacional de Investigaciones Cientificas y Tecnicas (CONICET), Argentina
7Clinical Research Institute, School of Medicine, Universidad Nacional de Colombia, Colombia
8Centro Documentacion Conjunto OPS/OMS y CLAP/SMR-OPS/OMS. PAHO/WHO and CLAP/WR-PAHO/WHO Joint Documentation Center, Uruguay
9Departamento de Ciencias de la Salud-Universidad Nacional del Sur, Argentina
10Institute for Clinical Effectiveness and Health Policy. Buenos Aires, Argentina
11Centro Colaborador Uruguay—Fondo Nacional de Recursos, Uruguay
12Dirección de Investigación y Centro Cochrane, Instituto Nacional de Perinatologia. Ministerio de Salud, México
13Subdirección de Evaluación Clínica de Tecnologías en Salud, Centro Nacional de Excelencia Tecnológica en Salud (CENETEC- SALUD), México
14Comité de Docencia e Investigación, Hospital Tornú, Buenos Aires, Argentina
15Centro de la Colaboración Cochrane Guatemala, Centro de Investigaciones de las Ciencias de la Salud, Facultad de Ciencias Médicas, Universidad de San Carlos de Guatemala, Guatemala
16Unidad de Epidemiologia Clinica, Universidad Peruana Cayetano Heredia, Peru
17CRONICAS-Universidad Peruana Cayetano Heredia, Peru
18Facultad de Odontologia, Universidad de la Republica, Uruguay
19Servicios Cooperativos de Informacion—SCI, BIREME/OPS/OMS, Brasil
20Department of Internal Medicine, Faculty of Medicine, Pontificia Universidad Catolica de Chile, Chile
21Department of Family Medicine, Faculty of Medicine, Pontificia Universidad Catolica de Chile, Chile
22El Salvador Cochrane Division from Central American Branch of the Cochrane Iberoamerican Center, El Salvador
23Health Policiy and System Research Unit, Pontificia Universidad Catolica de Chile, Chile
24Centro Rosarino de Estudios Perinatales, Argentina
25Clinica Medica, Hospital Universitario Austral Pilar, Argentina
Abstract
Background: It is desirable to have easy access to systematic reviews (SRs) instead of narrative reviews (NRs). Databases’ methodological filters are good in identifying reviews of the literature but SRs are gathered together with NRs. Considering current limitations of most databases to classify reviews methodologically, we developed a collaborative web-based software to select SRs in LILACS.

Objectives: • To identify SRs in LILACS using DARE (Database of Abstracts of Reviews of Effects) and other relevant criteria • To assess the accurateness of some criteria on title/abstract for SRs identification.

Methods: A search strategy (based on Montori 2005, DARE and the Ecuador Cochrane Center strategies) was conducted from January 2008 to February 2011. Study selection was performed through EROS (Early Review Organizing Software), a web-based software to serve in the initial phases of a SR process. Pairs of researchers independently assessed criteria of SR by titles/abstracts and then by full text, considering DARE criteria as the reference test for confirmed SR (Box 1). Discrepancies were solved by consensus or by a third reviewer if consensus were not reached.

Results: The search strategy retrieved 2241 references with 1786 full-texts available. In total, 15% of the assessed full-texts were classified as SRs based on DARE criteria, while only 1.3% using Oxman & Guyatt and 1% using Cochrane criteria. The accuracy of title/abstract criteria to select SRs compared to DARE criteria are presented in Table 1.

Conclusion: • This collaborative model will allow LILAC’s users to easily access to confirmed SRs by incorporating labels into LILACS. • The proportion of confirmed SRs out of references retrieved by Montori filter was still low. • Studies not calling themselves as a SRs or meta-analysis in the title/abstract had the highest Negative Predictive Value (97%) and those performing a meta-analysis had the highest Positive Predictive Value (88%).