Use of the Comments and Criticisms Facility: Pilot experience with new systematic reviews

Article type
Authors
Deeks JJ, Herxheimer A
Abstract
Objective: The Comment and Criticisms feature of the Cochrane Library was introduced with the 2nd disk release in April 1997. This survey aims to explore some of the dimensions of its potential use and acceptability from the perspective of two library user's and those receiving their comments.

Methods: Reviews were selected from the 2nd 1997 disk release of the Cochrane Library. Structured sampling methods were used to ensure that comments were directed at reviews from as many CRGs as possible, and that new reviews were critiqued first. Reviews were read by both an experienced reviewer and trainer (JD) and an experienced user (AH). Their comments ranged from technical statistical issues through to problems in user friendliness. The tone of the original comments, together with that of the review authors' responses was rated by an independent assessor. In addition, authors were asked about their experience in receiving criticism once they had responded to the original comments.

Results: The analyses will examine the aspects of the review for which criticisms are made (e.g. relating to problem conception, review methods, presentation, interpretation and absence of alternative perspectives), the timeliness and nature of the responses, together with the authors' experience of receiving and replying to the criticism.