Citation bias in imaging research: are studies with higher diagnostic accuracy estimates cited more often?

Tags: Poster
Frank R1, Dehmoobadsharifabadi A1, Salameh J2, McGrath T1, Kraaijpoel N3, Dang W4, Li N5, Gauthier I1, Wu M6, Bossuyt P3, Levine D7, McInnes M8
1Department of Radiology, Faculty of Medicine, University of Ottawa, 2Clinical Epidemiology Program, Ottawa Hospital Research Institute, University of Ottawa, 3Clinical Epidemiology and Biostatistics and Bioinformatics, Amsterdam Public Health Research Institute, Academic Medical Center, University of Amsterdam, 4Department of Radiology, The Ottawa Hospital, 5Department of Radiology, Faculty of Medicine, University of Ottawa , 6Department of Radiology, The Ottawa Hospital , 7Department of Radiology, Beth Israel Deaconess Medical Center, and Radiology Editorial Office, 8Department of Radiology, The Ottawa Hospital and University of Ottawa, and Clinical Epidemiology Program, Ottawa Hospital Research Institute

Background:

Citation bias (preferential citation of articles with favorable results) inflates the perceived value of certain studies, which can influence the evidence clinicians choose to inform their clinical decisions. Citation bias is well-documented in therapeutic trials, but has not been explored among diagnostic accuracy studies.

Objective:

To evaluate whether imaging diagnostic accuracy studies with higher accuracy estimates are cited more often than those with lower estimates.

Methods:

We searched MEDLINE for diagnostic accuracy meta-analyses published in imaging journals from January 2005 to April 2016. We screened primary studies from the meta-analyses; those that assessed the diagnostic accuracy of an imaging test and reported sensitivity (SN) and specificity (SP) were eligible for inclusion. We excluded studies not indexed in Web of Science, duplicates, and inaccessible articles. We extracted data on study topic (modality/subspecialty), study design, sample size, impact factor, publication date, times cited, highest SN and highest SP for each study. Negative binomial regression analysis was performed to evaluate for association of citation rate (times cited per month since publication) with Youden's index, highest SN, and highest SP, controlling for the potential confounding effects of modality, subspecialty, impact factor, study design, sample size, and source meta-analysis.

Results:

We included 1016 primary studies (Figure 1). Youden's index demonstrated a moderate positive association with citation rate, yielding a regression coefficient of 0.33 (P = 0.016). Regression coefficients for association of SN and SP with citation rate were 0.41 (P = 0.034) and 0.32 (P = 0.15), respectively (Table 1).

Conclusions:

A moderate positive association exists between diagnostic accuracy estimates and citation rates, indicating that citation bias is present in imaging diagnostic accuracy literature.

Patient involvement:

Citation bias in diagnostic accuracy research could lead clinicians to over-estimate the accuracy of imaging tests; this may contribute to patient harm from incorrect interpretation of test results. Identification of this risk is critical in improving the quality of the literature that guides patient care.