Article type
Abstract
Background
Textual evidence often represents the best available evidence where formal research on the specific topic is limited or nonexistent. As with other sources of evidence, critical appraisal is necessary to evaluate trustworthiness, value, and relevance in a particular context. Over 20 years ago, JBI identified the importance of including textual evidence in synthesis work and developed one tool for critical appraisal that could be used for all types of textual evidence.
Objectives
Three related, but distinctive, sources of textual evidence exist in the form of narrative, expert opinion, and policy. For purposes of synthesis, it is essential to acknowledge the unique nature of these data sources, particularly in relation to critical appraisal, because the specific strategies/questions required to effectively interrogate the legitimacy and authenticity of these 3 data sources is quite different. The objective was to create new critical appraisal tools aligned with these different types of textual evidence.
Methods
The JBI Textual Evidence Methodology group convened over a year through discourse and examination of previous textual evidence systematic reviews, extant literature regarding textual and opinion evidence, and working through examples. While public consumers are beneficiaries of this work, they were not directly involved in these efforts.
Results
The current JBI critical appraisal tools have been updated and presented separately according to the textual source (narrative, expert opinion, or policy). Narrative refers to first-hand accounts of experience, perspective or views of patients, health professionals, or other stakeholders. Expert opinion draws on the knowledge and experience of experts (both practitioners and consumers), and frequently, extant external evidence informs the opinion. Policy, for our purposes, refers to a deliberate set of principles designed to guide decisions and achieve rational outcomes. In health care, a policy is often presented as a procedure, protocol, or consensus guidelines.
Conclusions
Through an engaged, international, and collaborative process, a rigorous evaluation of the current appraisal tools for textual evidence was conducted and 3 new appraisal tools were developed. These tools are published and globally available for no charge via JBI’s website.
Textual evidence often represents the best available evidence where formal research on the specific topic is limited or nonexistent. As with other sources of evidence, critical appraisal is necessary to evaluate trustworthiness, value, and relevance in a particular context. Over 20 years ago, JBI identified the importance of including textual evidence in synthesis work and developed one tool for critical appraisal that could be used for all types of textual evidence.
Objectives
Three related, but distinctive, sources of textual evidence exist in the form of narrative, expert opinion, and policy. For purposes of synthesis, it is essential to acknowledge the unique nature of these data sources, particularly in relation to critical appraisal, because the specific strategies/questions required to effectively interrogate the legitimacy and authenticity of these 3 data sources is quite different. The objective was to create new critical appraisal tools aligned with these different types of textual evidence.
Methods
The JBI Textual Evidence Methodology group convened over a year through discourse and examination of previous textual evidence systematic reviews, extant literature regarding textual and opinion evidence, and working through examples. While public consumers are beneficiaries of this work, they were not directly involved in these efforts.
Results
The current JBI critical appraisal tools have been updated and presented separately according to the textual source (narrative, expert opinion, or policy). Narrative refers to first-hand accounts of experience, perspective or views of patients, health professionals, or other stakeholders. Expert opinion draws on the knowledge and experience of experts (both practitioners and consumers), and frequently, extant external evidence informs the opinion. Policy, for our purposes, refers to a deliberate set of principles designed to guide decisions and achieve rational outcomes. In health care, a policy is often presented as a procedure, protocol, or consensus guidelines.
Conclusions
Through an engaged, international, and collaborative process, a rigorous evaluation of the current appraisal tools for textual evidence was conducted and 3 new appraisal tools were developed. These tools are published and globally available for no charge via JBI’s website.