Developing summary of findings tables in network meta-analysis: a user testing study

Tags: Oral
Yepes-Nuñez JJ1, Li S2, Guyatt G1, Brozek J1, Beyene J1, Santesso N1, Schunemann H1
1McMaster University, Canada, 2University of Toronto, Canada

Background: When multiple interventions have been used and compared for the same disease and outcomes, network meta-analysis (NMA) uses direct and indirect comparisons to provide an estimate of their relative effectiveness. The optimal presentation and interpretation of NMA results for users remains uncertain.

Objectives: To develop NMA-'Summary of findings' (SoF) tables that display key aspects of NMA results.

Methods: Through brainstorming and pilot testing, we have developed a format for NMA-SoF tables and are currently evaluating them through formal user-testing methodology. We are currently conducting the first of up to three rounds of interviews. One round consists of ten interviews, each with a user who is presented with the NMA-SoF table. A user was defined as someone who had used a meta-analysis or NMA at least once in the previous year to answer research or clinical questions related to patient health care. Users were recruited through networks linked to the GRADE Working Group by email. After each round, the NMA-SoF table will be modified based on data provided by the users. A refined version of the NMA-SoF table will be presented to a new set of users in a subsequent round. Fewer than three rounds may be necessary if all participants find a particular format or formats fully informative and appealing.

Results: At the end of this study, we expect to have one or more formats of NMA-SoF table that summarize the NMA results which users find informative and usable.

Conclusions: Effective presentation can increase the usability and help health professionals make better-informed decisions. Our work aims to meet an urgent need for optimal formats for NMA-SoFs.