Skip to main content

Languages

Presentation of continuous outcomes in meta-analysis: a survey of clinicians' understanding and preferences

Date and Location

Session: 

P4.097

Date

Monday 23 September 2013 - 10:30 - 12:00

Location

Presenting author and contact person

Presenting author

Bradley Johnston

Contact person

Bradley Johnston
Abstract text
Background: When pooling results of trials addressing continuous outcome using different instruments to measure the same construct, authors typically report differences between intervention and control as a Standardized Mean Difference (SMD). Recently, authors have proposed alternative summary estimates that they postulate clinicians' will more easily interpret than SMD (1-4). The GRADE Working Group recently provided an overview of methods for presenting pooled continuous data (5). Thus far, claims of improved understanding with allegedly clinician-friendly presentations are supported only by anecdotes. Objectives: To determine clinicians’ understanding and perceptions of 6 approaches (SMD, Minimal Important Difference Units, Natural Units, Relative Risk, Risk Difference and Ratio of Means) to the presentation of continuous outcomes from meta-analyses. Methods: We invited 201 staff, residents, and trainees in family medicine and internal medicine academic programs in Canada, Switzerland and Lebanon to participate. Participants received paper-based self-administered surveys presenting summary estimates of hypothetical interventions versus placebo for chronic pain, with results demonstrating either a small effect or large effect for each of the 6 presentation approaches. We asked 6 questions addressing understanding and 6 questions addressing preferences. We randomized participants to size of effect and order. Results: 188 clinicians responded (Table 1), with 175 providing completed surveys (87% response rate). Risk Difference was the approach best understood by clinicians, followed by the Ratio of Means and Relative Risk (Table 2). Clinicians generally found dichotomous presentation of continuous outcomes (Relative Risk; Risk Difference) very useful, and other approaches less useful (Table 3). Conclusions: Clinicians best understood continuous outcomes when presented as dichotomies (relative and absolute risk differences) and found these presentations most useful. Presenting results as SMD, the longest standing and most widely used approach, was poorly understood and not perceived as useful. Data collection is ongoing and full results will be available at the colloquium.
Attachments