Article type
Year
Abstract
Background:
Effective evidence use in public health decision-making is impeded by evidence that does not meet decision-maker and public health practitioners' needs. This includes issues in the generalisability of evidence both in terms of the feasibility of running interventions (applicability) and whether the same direction and magnitude of effect sizes would be observed (transferability).
Objectives:
This presentation will report on work undertaken to:
1) design more effective ways in which systematic review authors can consider the generalisability of their findings; and
2) explore the transferability of the overall effect, using an example from a review of asthma self-management in schools.
Methods:
The first objective is addressed through developing structured summaries of generalisability within review software (EPPI-Reviewer) based on recommended reporting practices and existing generalisability tools. The second is addressed through developing and testing new methods of using contextual data to assess the transferability of meta-analytic evidence. In this presentation, using an example from a review of school-based asthma interventions, we undertake a form of enhanced subgroup analysis to identify clusters of dis/similar studies.
Results:
We outline some of the ways in which systematic review authors can better report the generalisability of studies and evidence through EPPI-Reviewer. Preliminary work on enhancing the transferability of meta-analysis involved the re-analysis of findings from a systematic review of school-based asthma interventions, and exploring the differential impact if the intervention was run in London schools. Analysis of school absences suggests that sites more similar to London schools in terms of the ethnic profile, baseline level of school absence and gender split of children recorded less improvement in levels of absence than those that were dissimilar. We will discuss the potential reasons for this discrepancy and how this information can be valuable to decision-makers. In addition, we will explore potential drawbacks of the method, as well as future avenues for research.
Patient or healthcare consumer involvement:
EPPI-Reviewer users will be involved in creating the new capacity. In addition, the steps undertaken are based on previous work with public health practitioners.
Effective evidence use in public health decision-making is impeded by evidence that does not meet decision-maker and public health practitioners' needs. This includes issues in the generalisability of evidence both in terms of the feasibility of running interventions (applicability) and whether the same direction and magnitude of effect sizes would be observed (transferability).
Objectives:
This presentation will report on work undertaken to:
1) design more effective ways in which systematic review authors can consider the generalisability of their findings; and
2) explore the transferability of the overall effect, using an example from a review of asthma self-management in schools.
Methods:
The first objective is addressed through developing structured summaries of generalisability within review software (EPPI-Reviewer) based on recommended reporting practices and existing generalisability tools. The second is addressed through developing and testing new methods of using contextual data to assess the transferability of meta-analytic evidence. In this presentation, using an example from a review of school-based asthma interventions, we undertake a form of enhanced subgroup analysis to identify clusters of dis/similar studies.
Results:
We outline some of the ways in which systematic review authors can better report the generalisability of studies and evidence through EPPI-Reviewer. Preliminary work on enhancing the transferability of meta-analysis involved the re-analysis of findings from a systematic review of school-based asthma interventions, and exploring the differential impact if the intervention was run in London schools. Analysis of school absences suggests that sites more similar to London schools in terms of the ethnic profile, baseline level of school absence and gender split of children recorded less improvement in levels of absence than those that were dissimilar. We will discuss the potential reasons for this discrepancy and how this information can be valuable to decision-makers. In addition, we will explore potential drawbacks of the method, as well as future avenues for research.
Patient or healthcare consumer involvement:
EPPI-Reviewer users will be involved in creating the new capacity. In addition, the steps undertaken are based on previous work with public health practitioners.