Article type
Year
Abstract
Background:
Qualitative evidence syntheses are increasingly used to bring together findings from qualitative studies. However, it is difficult to use these findings to inform decisions because the methods to assess how much confidence to place in these synthesis findings are poorly developed.
Objectives:
To describe a new version of a tool for assessing how much confidence to place in the evidence from qualitative research reviews.
Methods:
The Confidence of the Evidence from Reviews of Qualitative research (CERQual) tool was developed through the review of existing tools; working group discussions; and piloting of the tool on several qualitative evidence syntheses.
Results:
CERQual bases the assessments of confidence on four components: (1) the methodological quality of the individual studies contributing to a review finding, was assessed by using a quality-assessment tool for qualitative studies (2) the coherence of each review finding, assessed by looking at the extent to which the finding is based on data that is similar across multiple individual studies and/or incorporates (plausible) explanations for any variations across individual studies (3) the relevance of a review finding, assessed by determining to what extent the evidence supporting a review finding is applicable to the context specified in the review question (4) the sufficiency of data supporting a review finding, assessed by an overall determination of the degree of richness and/or scope of the evidence and quantity of data supporting a review finding. After assessing each component, an overall judgement of the confidence in each review finding is made. The confidence can be judged as high, moderate, low, or very low. This assessment should be described and justified in a transparent manner, preferably in a summary of qualitative findings table that includes narrative statements.
Conclusions:
CERQual provides a transparent method for assessing the confidence of evidence from reviews of qualitative research. Like the GRADE approach, it may facilitate the use of these findings alongside reviews of effects and in guideline development processes.
Qualitative evidence syntheses are increasingly used to bring together findings from qualitative studies. However, it is difficult to use these findings to inform decisions because the methods to assess how much confidence to place in these synthesis findings are poorly developed.
Objectives:
To describe a new version of a tool for assessing how much confidence to place in the evidence from qualitative research reviews.
Methods:
The Confidence of the Evidence from Reviews of Qualitative research (CERQual) tool was developed through the review of existing tools; working group discussions; and piloting of the tool on several qualitative evidence syntheses.
Results:
CERQual bases the assessments of confidence on four components: (1) the methodological quality of the individual studies contributing to a review finding, was assessed by using a quality-assessment tool for qualitative studies (2) the coherence of each review finding, assessed by looking at the extent to which the finding is based on data that is similar across multiple individual studies and/or incorporates (plausible) explanations for any variations across individual studies (3) the relevance of a review finding, assessed by determining to what extent the evidence supporting a review finding is applicable to the context specified in the review question (4) the sufficiency of data supporting a review finding, assessed by an overall determination of the degree of richness and/or scope of the evidence and quantity of data supporting a review finding. After assessing each component, an overall judgement of the confidence in each review finding is made. The confidence can be judged as high, moderate, low, or very low. This assessment should be described and justified in a transparent manner, preferably in a summary of qualitative findings table that includes narrative statements.
Conclusions:
CERQual provides a transparent method for assessing the confidence of evidence from reviews of qualitative research. Like the GRADE approach, it may facilitate the use of these findings alongside reviews of effects and in guideline development processes.