Challenges and strategies for implementing the STAR tool of comprehensive evaluation for guidelines: a qualitative study with Chinese physicians

Article type
Authors
Wang X1, Chen Y, Yang N
1Research Unit of Evidence-Based Evaluation and Guidelines, Chinese Academy of Medical Sciences (2021RU017), School of Basic Medical Sciences, Lanzhou University; Key Laboratory of Evidence Based Medicine of Gansu Province,; WHO Collaborating Centre for Guideline Implementation and Knowledge Translation
Abstract
"Background: The scientific, transparent and applicable rankings (STAR) working group has developed a new guideline evaluation tool and regularly conducts comprehensive evaluations of guidelines and consensus statements from China.

Objectives: In this study, we used qualitative interviews to collect and discuss the experience and views of STAR working group members on STAR.

Methods: From March to August 2023, members of the STAR specialist committees with experience in guideline development and STAR evaluation were invited to participate in semi-structured interviews using a purpose-based sampling method. To ensure consistency between interviews, the research team designed a semi-structured interview outline based on the previous experience of the STAR working group and relevant research. We used subject analysis to summarize the results.

Results: Thirty-seven interviewees from 35 specialist committees of the STAR working group were interviewed. The interview results were categorized into four primary and 16 secondary topics. According to the responses, the main value and significance of STAR is in promoting the locally developed guideline evaluation tools and the formulation and selection of high-quality guidelines in China. The management and operation of STAR need more resource support, and the organizational structure needs to be optimized, collaboration between the contributors enhanced, and the efficiency of the evaluation improved. The STAR tool should be complemented with extensions for different types of guidelines, some items need to be adjusted, and the applicability of guidelines should be covered better. And the dissemination and promotion of STAR needs strengthening. In the future, the establishment of an international committee should be considered to promote the internationalization of STAR.

Conclusion: STAR has contributed substantially to the evaluation of guidelines in China. The findings from the interviews can provide valuable guidance for the further improvement of STAR."