Systematic reviews and meta-analyses of traditional Chinese medicine must search Chinese databases to reduce language bias

Article type
Authors
Wu X1, Tang J2, Mao C2, Yuan J1, Qin Y1, Chung V1
1The Chinese University of Hong Kong, China
2The Hong Kong Branch of the Chinese Cochrane Centre, China
Abstract
Background: Systematic reviews that fail to search non-English databases may miss relevant studies and cause selection bias. The bias may be particularly severe in systematic reviews of traditional Chinese medicine (TCM) as most randomized controlled trials (RCT) in TCM are published and accessible only in Chinese.
Objectives: In this study we investigated how often Chinese databases were not searched in systematic reviews of TCM, how many trials were missed, and whether a bias may occur if Chinese databases were not searched.
Methods & Results: We searched five databases in English and three in Chinese for RCTs of Chinese herbal medicine for coronary artery disease and found that 96.64% (115/119) of eligible studies could be identified only from Chinese databases. In a random sample of 80 Cochrane Reviews on TCM, we found that Chinese databases were only searched in 43 (53.75%), in which almost all the included studies were identified from Chinese databases. We also compared systematic reviews of the same topic and found that they may draw a different conclusion if Chinese databases were not searched.
Conclusions: In conclusion, an overwhelmingly high percentage of eligible trials on TCM could only be identified in Chinese databases. We suggest that reviewers of TCM search Chinese databases to reduce potential selection bias.