To filter or not to filter? A study examining the use of diagnostic test accuracy search filters on a Cochrane DTA review

Article type
Authors
Noel-Storr A1, Malouf R, McShane R, Marcus S
1Nuffield Dept Medicine, Oxford University, Oxford, UK
Abstract
Background: For years now the work of Trials Search Coordinators has been improved by the development of RCT filters for sensitive searches for healthcare interventions (at least for the major the healthcare databases such as MEDLINE). Now, however, with the Collaboration s expansion into the area of diagnostic test accuracy reviews, the question of whether a filter can be or should be applied to searches for studies once again raises its ugly head. Aims: The Cochrane Dementia and Cognitive Improvement Group (CDCIG) are now well underway with their first DTA review. The searches for this review will be run without a filter (in accordance with current Cochrane guidance). However, using this review, a small additional study has been designed which will look at the sensitivity and specificity of the search strategies when filters are applied. Methods: Searches will be run for this review without a filter. Those results will be assessed for studies for inclusion and exclusion within the review as usual. The searches will then be run again five times; each time with a different, already existing DTA filter. The sensitivity and specificity of each filter will then be assessed using the results from the searches without a filter as the reference standard. Results: The results of this study will be of interest to the Cochrane Dementia and Cognitive Improvement Group. They will form the first set of data which may then be used at a later date with data from other CDCIG DTA reviews. The results will be displayed on a ROC curve, and will be sub-divided into included and excluded studies retrieved with and without a filter. Conclusion: This is a small study, looking at one review only. While it will not be possible to base further practice on the results of this one study, it is hoped that it will add to the already existing discussion on the subject and provide further evidence on the efficacy (or not) of certain DTA filters.