Could do better? Search methods in recent oral health systematic reviews

Article type
Authors
Morgan F, Turley R, Chadwick B
Abstract
Background: The validity of systematic reviews is dependent on finding all the available evidence. Previous papers [1,2] examining oral health systematic reviews have highlighted inadequate search strategies as a major weakness in these reviews. The Oral Health Specialist Library (www.library.nhs.uk/oralhealth), part of the National Library for Health, conducts comprehensive annual searches to identify newly published oral health systematic reviews. Following appraisal, those meeting Library quality criteria are added to the site. This update provides an opportunity to explore whether search methods are improving. Objectives: To examine and report on the quality of search methods used oral health systematic reviews published in 2007. Methods: An electronic search for systematic reviews was conducted in the following databases: AMED, ASSIA, CINAHL, MEDLINE, MEDLINE-in-Process, EMBASE and PsycINFO using the methodology outlined in the Library’s Quality Policy [3]. In addition, we handsearched twelve oral health journals. All papers were critically appraised and checked by a second reviewer. Results: The search identified 1494 citations of which 245 were reviewed in full text. Eighty-six papers met the Library’s eligibility criteria for critical appraisal, of which 31 were new or updated Cochrane reviews. Search methods employed in the majority of reviews were poor. Frequently, only one database (MEDLINE/PubMed) was searched, no attempt was made to identify unpublished papers and the search was restricted to the English language. Search terms, where reported, were not sufficiently comprehensive. Conclusions: Search methods employed in many of the most recent reviews were unlikely to identify all relevant studies. This failure potentially compromises their findings. Researchers must devote more attention to developing comprehensive search strategies and may benefit from employing the expertise of information specialists in this process. References: [1] Glenny AM, Esposito M, Coulthard P, Worthington HV. The assessment of systematic reviews in dentistry. Euro J Oral Sci 2003;111(2):85-92. [2] Flores-Mir C, Major MP, Major PW. Search and selection methodology of systematic reviews in orthodontics (2000-2004). Am J Orthod Dentofacial Orthop 2006;130(2):214-7. [3] http://www.library.nhs.uk/oralhealth/Page.aspx?pagename=QUALITYPOL