Article type
Year
Abstract
Background: Although Cochrane has conducted training in systematic review methods since its inception, these activities have undergone only superficial evaluation based on attendance rates or participant satisfaction. The Cochrane Central Executive is initiating a new program to test our success in conveying the skills and knowledge required to complete a Cochrane review more rigorously, and to contribute to the body of research in the teaching of evidence-based medicine and research methods.
Objectives: To identify a tool to assess skills and knowledge in conducting systematic reviews, and evaluate the effectiveness of Cochrane training in systematic review methods.
Methods: An assessment tool to assess the skills and knowledge required to conduct systematic reviews will be identified, and any necessary adaptation of the tool completed. As it is likely that the tool will have been developed for a different purpose (such as appraisal or reporting of systematic reviews), the tool will be validated with a diverse sample of authors to ensure construct validity and discrimination between different levels of expertise. A standardised program of evaluation will then be implemented across the Cochrane Trainers’ Network. This will enable the tool to be tested across a much larger sample, including participants in face-to-face and online training, while providing access for the first time to a data set assessing the skills and knowledge of trainee Cochrane authors. Additional components of the evaluation program will include a review of Cochrane Training materials to ensure alignment with core skills and knowledge; an assessment of first submitted draft manuscripts to assess implementation of skills and knowledge in practice; and an audit of equity of participation in training by geographically and linguistically diverse authors.
Results: Preliminary results and detailed project plans for this evaluation program will be presented.
Conclusions: We anticipate that progress towards a meaningful evaluation of the effectiveness of Cochrane training activities will benefit both authors and trainers, and ultimately improve the quality of Cochrane systematic reviews.
Objectives: To identify a tool to assess skills and knowledge in conducting systematic reviews, and evaluate the effectiveness of Cochrane training in systematic review methods.
Methods: An assessment tool to assess the skills and knowledge required to conduct systematic reviews will be identified, and any necessary adaptation of the tool completed. As it is likely that the tool will have been developed for a different purpose (such as appraisal or reporting of systematic reviews), the tool will be validated with a diverse sample of authors to ensure construct validity and discrimination between different levels of expertise. A standardised program of evaluation will then be implemented across the Cochrane Trainers’ Network. This will enable the tool to be tested across a much larger sample, including participants in face-to-face and online training, while providing access for the first time to a data set assessing the skills and knowledge of trainee Cochrane authors. Additional components of the evaluation program will include a review of Cochrane Training materials to ensure alignment with core skills and knowledge; an assessment of first submitted draft manuscripts to assess implementation of skills and knowledge in practice; and an audit of equity of participation in training by geographically and linguistically diverse authors.
Results: Preliminary results and detailed project plans for this evaluation program will be presented.
Conclusions: We anticipate that progress towards a meaningful evaluation of the effectiveness of Cochrane training activities will benefit both authors and trainers, and ultimately improve the quality of Cochrane systematic reviews.