Article type
Year
Abstract
Background: When pooling results of trials addressing continuous outcome using different instruments to measure the same construct, authors typically report differences between intervention and control as a Standardized Mean Difference (SMD). Recently, authors have proposed alternative summary estimates that they postulate clinicians’ will more easily interpret than SMD (1–4). The GRADE Working Group recently provided an overview of methods for presenting pooled continuous data (5). Thus far, claims of improved understanding with allegedly clinician-friendly presentations are supported only by anecdotes.
Objectives: To determine clinicians’ understanding and perceptions of six approaches (SMD, Minimal Important Difference Units, Natural Units, Relative Risk, Risk Difference and Ratio of Means) to the presentation of continuous outcomes from meta-analyses.
Methods: We invited 201 staff, residents, and trainees in family medicine and internal medicine academic programs in Canada, Switzerland and Lebanon to participate. Participants received paper-based self-administered surveys presenting summary estimates of hypothetical interventions versus placebo for chronic pain, with results demonstrating either a small effect or large effect for each of the six presentation approaches. We asked six questions addressing understanding and six questions addressing preferences. We randomized participants to size of effect and order.
Results: 188 clinicians responded (Table 1), with 175 providing completed surveys (87% response rate). Risk Difference was the approach best understood by clinicians, followed by the Ratio of Means and Relative Risk (Table 2). Clinicians generally found dichotomous presentation of continuous outcomes (Relative Risk; Risk Difference) very useful, and other approaches less useful (Table 3).
Conclusions: Clinicians best understood continuous outcomes when presented as dichotomies (relative and absolute risk differences) and found these presentations most useful. Presenting results as SMD, the longest standing and most widely used approach, was poorly understood and not perceived as useful. Data collection is ongoing and full results will be available at the colloquium.
Objectives: To determine clinicians’ understanding and perceptions of six approaches (SMD, Minimal Important Difference Units, Natural Units, Relative Risk, Risk Difference and Ratio of Means) to the presentation of continuous outcomes from meta-analyses.
Methods: We invited 201 staff, residents, and trainees in family medicine and internal medicine academic programs in Canada, Switzerland and Lebanon to participate. Participants received paper-based self-administered surveys presenting summary estimates of hypothetical interventions versus placebo for chronic pain, with results demonstrating either a small effect or large effect for each of the six presentation approaches. We asked six questions addressing understanding and six questions addressing preferences. We randomized participants to size of effect and order.
Results: 188 clinicians responded (Table 1), with 175 providing completed surveys (87% response rate). Risk Difference was the approach best understood by clinicians, followed by the Ratio of Means and Relative Risk (Table 2). Clinicians generally found dichotomous presentation of continuous outcomes (Relative Risk; Risk Difference) very useful, and other approaches less useful (Table 3).
Conclusions: Clinicians best understood continuous outcomes when presented as dichotomies (relative and absolute risk differences) and found these presentations most useful. Presenting results as SMD, the longest standing and most widely used approach, was poorly understood and not perceived as useful. Data collection is ongoing and full results will be available at the colloquium.