Article type
Year
Abstract
Background:
The National Collaborating Centre for Methods and Tools (NCCMT) champions the use of evidence in decision-making. We share knowledge about what works in public health and provide high-quality resources as well as essential training and mentoring to support capacity development for evidence-informed decision making. The result is that practitioners make informed decisions so that all people living in Canada can achieve optimal health. As an essential component to this work, the NCCMT recognizes the importance of high-quality evaluations that are underpinned by a rigorous framework.
Objectives:
The NCCMT developed an evaluation framework to effectively illustrate the impact of the NCCMT in relation to the reach of the centre’s activities, the quality of available products and services, and the impact on public health professionals and organizations. The goal of this framework is to guide evaluations of our programs and services to ensure that the NCCMT’s resources and training continue to be high quality and meet the needs of public health professionals globally.
Methods:
The NCCMT contracted an external program evaluation expert to assist in the development of a revised evaluation framework that would better capture: reach, quality and impact. The contractor reviewed a number of internal documents: vision, mission, goals; annual workplans; annual reports (submitted to funder), and previous evaluation reports. A review of program evaluation literature was also conducted. An inductive approach was used to identify evaluation themes.
Results:
A revised evaluation framework, influenced by theory of change, was developed and is now being implemented at the NCCMT. The evaluation framework encompasses four stages, each with specific outcome indicators identified, that progress from creation of products and services, to knowledge and awareness of these resources, to engagement and capacity development, and finally to policy and practices changes that become embedded within organizational structures. Specific outcome indicators include: confidence, knowledge, skills, organizational supports for evidence-informed decision making, using evidence in decision making, conducting rapid reviews; critical appraisal of evidence, improved programs, efficiency, engagement of workforce, and workforce competence for evidence-informed decision making.
Conclusions:
The innovative evaluation framework informed by theory of change resulted in significant streamlining of the NCCMT’s evaluation activities, and has provided clearer direction with respect to the purpose of evaluation, as well as enhanced ability to capture the centre’s reach, quality and impact.
Patient or healthcare consumer involvement:
Not applicable.
The National Collaborating Centre for Methods and Tools (NCCMT) champions the use of evidence in decision-making. We share knowledge about what works in public health and provide high-quality resources as well as essential training and mentoring to support capacity development for evidence-informed decision making. The result is that practitioners make informed decisions so that all people living in Canada can achieve optimal health. As an essential component to this work, the NCCMT recognizes the importance of high-quality evaluations that are underpinned by a rigorous framework.
Objectives:
The NCCMT developed an evaluation framework to effectively illustrate the impact of the NCCMT in relation to the reach of the centre’s activities, the quality of available products and services, and the impact on public health professionals and organizations. The goal of this framework is to guide evaluations of our programs and services to ensure that the NCCMT’s resources and training continue to be high quality and meet the needs of public health professionals globally.
Methods:
The NCCMT contracted an external program evaluation expert to assist in the development of a revised evaluation framework that would better capture: reach, quality and impact. The contractor reviewed a number of internal documents: vision, mission, goals; annual workplans; annual reports (submitted to funder), and previous evaluation reports. A review of program evaluation literature was also conducted. An inductive approach was used to identify evaluation themes.
Results:
A revised evaluation framework, influenced by theory of change, was developed and is now being implemented at the NCCMT. The evaluation framework encompasses four stages, each with specific outcome indicators identified, that progress from creation of products and services, to knowledge and awareness of these resources, to engagement and capacity development, and finally to policy and practices changes that become embedded within organizational structures. Specific outcome indicators include: confidence, knowledge, skills, organizational supports for evidence-informed decision making, using evidence in decision making, conducting rapid reviews; critical appraisal of evidence, improved programs, efficiency, engagement of workforce, and workforce competence for evidence-informed decision making.
Conclusions:
The innovative evaluation framework informed by theory of change resulted in significant streamlining of the NCCMT’s evaluation activities, and has provided clearer direction with respect to the purpose of evaluation, as well as enhanced ability to capture the centre’s reach, quality and impact.
Patient or healthcare consumer involvement:
Not applicable.