Background: The success of the evidence-based practice1 (EBP) movement depends on the effective dissemination of the EBP process model through training and its adoption by practitioners. This study reports on the validation of a scale that can be used in evaluations of the impact of such trainings and in surveys of practitioners regarding their views of EBP. Objectives: This study assesses the reliability, sensitivity, and criterion and factor validity of the EBPPAS, a 51-item scale that measures orientation toward EBP and five subscale constructs: self-efficacy, attitudes, perceived feasibility, and intentions to engage and self-reported engagement in EBP. Methods: Social work practitioners and MSW students were surveyed in four areas: Texas, Missouri, New York and Toronto. Systematic random sampling was used to recruit practitioners in all areas except New York, where all social work field instructors from a large university were surveyed. All MSW students were invited to participate in the study at four large schools of social work known for emphasizing EBP. Additional data was gathered in pretests and posttests of 97 practitioners participating in EBP continuing education workshops. Confirmatory factor analysis (CFA) procedures were used to assess the scale s factorial validity. Results: The overall scale had excellent internal consistency (a = .94), and four of the five subscales had alphas ranging from .83 to .91. Criterion validity was established in two ways: 1) Significant pre to post workshop change (with large effect sizes) and by significant correlations of the scale and subscales with prior exposure to EBP. The pre-post workshop change also supported the sensitivity of the scale. The CFA suggested the hypothesized five-factor structure of the scale had acceptable to good fit (X2/df=2.45, CFI=.90, RMSEA=.05, SRMR=.06). A second-order CFA supported an overall scale factor. Conclusions: This study provides preliminary support for the reliability, validity and sensitivity of the EBPPAS.
Reference: 1. Evidence-based practice is defined as the integration of best research evidence with clinical expertise and [client] values (Sackett and colleagues, 2000, p.1).