PERPETUATING FEARS: BIAS AGAINST THE NULL HYPOTHESIS IN FETAL SAFETY OF DRUGS AS EXPRESSED IN SCIENTIFIC CITATIONS
Main Article Content
Keywords
Congenital malformations, bias against the null, citation impact, oral contraceptives, bendectin?, benzodiazepines, paroxetine, ACE inhibitors, statins
Abstract
Background
Bias against negative studies (i.e., those showing no issues with fetal safety of drugs) may cause distorted interpretation with apparently safe drugs being labeled as teratogenic, causing women to terminate pregnancy or not to treat serious medical conditions.
Objective
To investigate whether “positive” studies, claiming teratogenic effects of drugs, which were later shown to be safe, have been cited more often than “negative” studies on the same topic.
Methods
We reviewed published studies on the fetal safety of 6 drugs, which were the focus of appreciable controversy over the last 5 decades (oral contraceptives, bendectin?, benzodiazepines, paroxetine, ACE inhibitors and statins). While initial highly publicized papers claimed teratogenic effects, these were subsequently contradicted by large numbers of “negative” studies. We compared medical citation patterns of the “positive” vs. “negative” papers related to these 6 drugs.
Results
“Positive” papers were 70% more likely to be cited than “negative” articles (median 39 vs. 23, p=0.04). In multivariate linear regression, “positivity” of results (p=0.04), the number of years since publication (p=0.01) and journal citation impact (p<0.001) all independently predicted the total number of medical citations.
Conclusions
We documented bias against the null hypothesis in medical citations of fetal drug safety. Acknowledging this source of bias is critical in trying to avert the distortion of the medical knowledge created by it.
References
2. Einarson TR, Leeder SJ, Koren G. A method for meta-analysis of epidemiological studies. Pharmacoepidemiol 1988;22:813-23.
3. Wilms LR, Tseng AL, Wighardt S, Einarson TR, Koren G. Fetal genital effects of firsttrimester sex hormone exposure: A metaanalysis. Obstet Gynecol 1995;85:141-9.
4. O’Brien L, Einarson TR, Sarkar M, Einarson A, Koren G. Does paroxetine cause cardiac malformations? J Obstet Gynaecol Can 2008;30:696-701.
5. Dolovich LR, Addis A, Vaillancourt R, Power B, Koren G. Benzodiazepine use in pregnancy and major malformations or oral cleft: metaanalysis of cohort and case-control studies. BMJ 1998;317: 839-43.
6. Koren G. Bias against the null hypothesis in maternal-fetal pharmacology and toxicology. Clin Pharmacol Ther 1997;62:1-5.
7. Koren G, Graham K, Shear H, Einarson T. Bias against the null hypothesis: The reproductive hazards of cocaine. Lancet 1989;2:1440-2.
8. Koren G, Klein N. Bias against negative studies in newspaper reports of medical research. JAMA 1991;266:1824-6.
9. Nora AH. Editorial: Can the pill cause birth defects? N Engl J Med 1974;291:731-2.
10. Neutel CI, Johansen HL. Measuring drug effectiveness by default: the case of Bendectin. Can J Public Health 1995;86:66-70.
11. Laegreid L, Olegard R, Wahlstrom J, Conradi N. Abnormalities in children exposed to benzodiazepines in utero. Lancet 1987;1:108-9.
12. Einarson A, Selby P, Koren G. Discontinuing antidepressants and benzodiazepines upon becoming pregnant. Beware of the risks of abrupt discontinuation. Can Fam Physician 2001;47:489-90.
13. Edison RJ, Muenke M. Central nervous system and limb anomalies in case reports of firsttrimester statin exposure. N Engl J Med 2004;350:1579-82.
14. Kazmin A, Garcia-Bournissen F, Koren G. Risks of statin use during pregnancy: a systematic review. J Obstet Gynaecol Can 2007;29:906-8.
15. Cooper WO, Hernandez-Diaz S, Arbogast PG, Dudley JA, Dyer S, Gideon PS, Hall K, Ray WA. Major congenital malformations after first-trimester exposure to ACE inhibitors. N Engl J Med 2006; 354:2443-51.
16. Tabacova S, Little R, Tsong Y, Vega A, Kimmel CA. Adverse pregnancy outcomes associated with maternal enalapril antihypertensive treatment. Pharmacoepidemiol Drug Saf 2003;12:633-46.
17. Lennestal R, Otterblad Olausson P, Kallen B. Maternal use of antihypertensive drugs in early pregnancy and delivery outcome, notably the presence of congenital heart defects in the infants. Eur J Clin Pharmacol 2009;65:615-25.
18. Jacqz-Aigrain E, Koren G. Effects of drugs on the fetus. Semin Fetal NeonatalMed 2005;10:139-47.
19. Greenberg SA. How citation distortions create unfounded authority: analysis of a citation network. BMJ 2009;339:b2680 (doi:10.1136/bmj.b2680)
20. Cohen LS, Altshuler LL, Harlow BL, et al. Relapse of major depression during pregnancy in women who maintain or discontinue antidepressant treatment. JAMA 2006;295:499-507.