Evaluating external validity, applicability and transferability of evidence to primary care setting

Article type
Authors
Nasser M1, van-Binsbergen J2, van-de-Laar F2, van-Weel C2, Fedorowicz Z3, Newton T4
1Health Information, German Institute for Quality and Efficiency in Health care (IQWiG), Cologne, Germany
2Cochrane primary care field, Department primary and community care, Radboud University Medical Centre, Nijmegen, Netherlands
3UKCC (Bahrain Branch), Bahrain Ministry of Health, Awali, Bahrain
4Division of Health and Social Care Research, King s College London, London, UK
Abstract
Background: Practitioners and decision makers need sufficient information on the external validity of trials in a systematic review to evaluate the applicability and transferability of the results to another population and setting. Objectives: To review the clinical trials of an ongoing Cochrane review in order to determine the extent to which external validity dimensions were reported, develop a conceptual framework to evaluate the applicability and transferability of the evidence to a primary care setting and apply it to the review. Methods: We applied the external validity tool (Green 2006) to evaluate reach and representativeness ; implementation and consistency of effect ; maintenance and institutionalization for the included studies of an ongoing Cochrane review on patient record systems in dental practice and developed a conceptual framework to demonstrate the factors that needs to be considered in evaluating the applicability and transferability of the results to a primary care setting. Results: One trial had a low (53%) participation rate (reach and representativeness) and the actual delivery of the intervention was 62% ( implementation and consistency of effect ). The only demographic factor reported was socioeconomic status. A majority (78%) of participants remained in the study after one year ( maintenance and institutionalization ). The second trial failed to report sufficient information on the recruitment strategy; the actual delivery and follow up was limited with (3% drop out). The conceptual framework helped to identify several factors that need to be considered to evaluate the applicability and transferability of the results of the review to a primary care setting. Conclusion: An external validity tool can help in judging the applicability and transferability of the evidence. The conceptual framework can help systematic reviewers and knowledge users to identify factors that needs to be considered in judging the applicability of evidence to a primary care setting. Green LW, Glasgow RE. Evaluating the relevance, generalization, and applicability of research: issues in external validation and translation methodology. Eval Health Prof. 2006 Mar;29(1): 126 53.