Reporting of absolute estimates of effect of patient important benefits and harms in abstracts of systematic reviews

Article type
Authors
Johnston B1, Alonso-Coello P2, Neumann I3, Carrasco-Labra A4, Brignardello-Petersen R4, Sun X5, Akl E6, Briel M7, Busse J8, Dahm P9, Glujovsky D10, Granados C8, Iorio A8, Irfan A11, Martinez L8, Mustafa R8, Ramirez-Morera A12, Solá I2, Sultan S13, Tikkinen K14, Vandvik P15, Zhang M8, Guyatt G8
1SickKids Research Institute & Department of Anaesthesia & Pain Medicine, The Hospital for Sick Children, Toronto, Canada
2Iberoamerican Cochrane Centre, Institute of Biomedical Research (IIB Sant Pau) Barcelona, Spain
3Department of Medicine, Pontificia Universidad Catolica de Chile, Santiago, Chile
4Evidence Based Dentistry Unit, Faculty of Dentistry, Universidad de Chile, Chile
5Centre for Health Research, Kaiser Permanente Northwest, Portland, Oregon, USA
6Department of Medicine, State University of New York at Buffalo, NY, USA
7Basel Institute for Clinical Epidemiology and Biostatistics, University Hospital Basel, Switzerland
8Department of Clinical Epidemiology & Biostatistics, McMaster University, Canada
9Department of Urology, College of Medicine, University of Florida, Gainesville, Florida, USA
10Argentine Cochrane Centre IECS (Institute for Clinical Effectiveness and Health Policy), Buenos Aires, Argentina
11Internal Medicine Residency Program, University of Illinois at Urbana-Champaign, Illinois, USA
12CCSS Permanent Medical Advisor, Health Care Development Division, IHCAI Foundation & Central America Cochrane, Costa Rica
13Division of Gastroenterology, Hepatology, and Nutrition, Malcom Randall Veterans Affairs Medical Center, University of Florida College of Medicine, Florida, USA
14Department of Urology, Helsinki University Central Hospital, Helsinki, Finland
15Norwegian Knowledge Centre for the Health Services, Oslo, Norway
Abstract
Background: For various reasons, readers of the literature may only refer the abstract of a systematic review to judge the magnitude of effects of alternative patient management strategies. Abstracts of systematic reviews reporting absolute estimates of effect (e.g. risk difference, number needed to treat) on the most patient important outcomes may facilitate decision-making.

Objectives: To determine, in Cochrane and non-Cochrane systematic reviews reporting dichotomous outcomes: (a) the concordance between abstracts and full texts in the reporting of patient important outcomes, and (b) the extent to which absolute estimates of effect are reported in the abstract.

Methods: We searched OVID Medline and the Cochrane Database of Systematic Reviews to identify eligible systematic reviews published in the year 2010. Citations were exported into Distiller (http://systematic-review.net/) and screened using pre-specified eligibility criteria. We stratified studies into two groups: Cochrane and non-Cochrane systematic reviews. Within each group, 100 reviews were randomly selected for data abstraction. Teams of two reviewers are using pre-tested and standardized forms with accompanying instructions, to select and abstract a pair-wise comparison, the most patient important outcomes of benefit and harm respectively, as well as population, intervention and design characteristics from the full-text of each included review. We will select the beneficial and harmful outcomes of interest using a hierarchical approach that will prioritize the outcome of most patient importance (Table 1 below).

Results: Data abstraction is ongoing. Analyses of the results will be presented as a descriptive summary (proportion reporting on each of our objectives) in a tabular format.

Conclusions: This project will determine the extent to which abstracts of systematic reviews report data on the most patient important benefits and harms consistently with the full text, and the extent to which such data are reported in absolute terms.
Images