Article type
Year
Abstract
Background: The development of strategies for systematic searches in bibliographic databases is a major challenge. The search strategies are often complex and may comprise several pages per database searched. The pertinent literature currently recommends a conceptual approach for the development of high-quality search strategies, which is based on a comprehensive collection of synonyms. However, an objectively-derived approach using terms identified in a text analysis may offer advantages. We conducted two projects to evaluate the objectively-derived approach. The first was a retrospective validation of the objectively-derived approach by means of published Cochrane Reviews. The results were promising, so that the conceptual and objectively-derived approaches were prospectively compared in a second project.
Objectives: To directly and prospectively compare the objectively-derived approach with the conceptual approach in the development of search strategies.
Methods: Search strategies were developed in parallel in MEDLINE for five different research questions: external experts used the conceptual approach to develop the related search strategies; IQWiG used the objectively-derived approach for the same research questions.
Results: The research questions of the five projects varied greatly and comprised searches for studies of tyrosine kinase inhibitors, renal cancer therapy, continuous blood-pressure measurement, effectiveness and sustainability of inpatient psychiatric rehabilitation for adults, and impeding and promoting factors in the implementation of clinical guidelines. The objectively-derived approach achieved a weighted mean sensitivity of 97% (95% confidence interval (CI) 94% to 100%) with a weighted mean precision of 5% (95% CI 1% to 10%). The conceptual approach achieved lower values, namely, a weighted mean sensitivity of 75% (95% CI 47% to 100%) and a weighted mean precision of 4% (95% CI 0% to 8%).
Conclusions: The objectively-derived approach for the development of search strategies achieves higher sensitivity than the conceptual approach. It produces robust search strategies and in particular offers advantages for complex research questions.
Objectives: To directly and prospectively compare the objectively-derived approach with the conceptual approach in the development of search strategies.
Methods: Search strategies were developed in parallel in MEDLINE for five different research questions: external experts used the conceptual approach to develop the related search strategies; IQWiG used the objectively-derived approach for the same research questions.
Results: The research questions of the five projects varied greatly and comprised searches for studies of tyrosine kinase inhibitors, renal cancer therapy, continuous blood-pressure measurement, effectiveness and sustainability of inpatient psychiatric rehabilitation for adults, and impeding and promoting factors in the implementation of clinical guidelines. The objectively-derived approach achieved a weighted mean sensitivity of 97% (95% confidence interval (CI) 94% to 100%) with a weighted mean precision of 5% (95% CI 1% to 10%). The conceptual approach achieved lower values, namely, a weighted mean sensitivity of 75% (95% CI 47% to 100%) and a weighted mean precision of 4% (95% CI 0% to 8%).
Conclusions: The objectively-derived approach for the development of search strategies achieves higher sensitivity than the conceptual approach. It produces robust search strategies and in particular offers advantages for complex research questions.