Selective reporting bias of harm outcomes within studies: findings from a cohort of systematic reviews

Saini, Pooja ORCID: 0000-0002-4981-7914, Loke, YK, Gamble, Carrol ORCID: 0000-0002-3021-1955, Altman, DG, Williamson, Paula ORCID: 0000-0001-9802-6636 and Kirkham, Jamie ORCID: 0000-0003-2579-9325 (2014) Selective reporting bias of harm outcomes within studies: findings from a cohort of systematic reviews. BMJ: British Medical Journal, 349 (7985). g6501-.

Access the full-text of this item by clicking on the Open Access link.

Text ORBIT 2.pdf - Published version Download (4MB)

Abstract

Objective: To determine the extent and nature of selective non-reporting of harm outcomes in clinical studies that were eligible for inclusion in a cohort of systematic reviews. Design: Cohort study of systematic reviews from two databases. Setting: Outcome reporting bias in trials for harm outcomes (ORBIT II) in systematic reviews from the Cochrane Library and a separate cohort of systematic reviews of adverse events. Participants: 92 systematic reviews of randomised controlled trials and non-randomised studies published in the Cochrane Library between issue 9, 2012 and issue 2, 2013 (Cochrane cohort) and 230 systematic reviews published between 1 January 2007 and 31 December 2011 in other publications, synthesising data on harm outcomes (adverse event cohort). Methods: A 13 point classification system for missing outcome data on harm was developed and applied to the studies. Results: 86% (79/92) of reviews in the Cochrane cohort did not include full data from the main harm outcome of interest of each review for all of the eligible studies included within that review; 76% (173/230) for the adverse event cohort. Overall, the single primary harm outcome was inadequately reported in 76% (705/931) of the studies included in the 92 reviews from the Cochrane cohort and not reported in 47% (4159/8837) of the 230 reviews in the adverse event cohort. In a sample of primary studies not reporting on the single primary harm outcome in the review, scrutiny of the study publication revealed that outcome reporting bias was suspected in nearly two thirds (63%, 248/393). Conclusions: The number of reviews suspected of outcome reporting bias as a result of missing or partially reported harm related outcomes from at least one eligible study is high. The declaration of important harms and the quality of the reporting of harm outcomes must be improved in both primary studies and systematic reviews.

Item Type:	Article
Uncontrolled Keywords:	Humans, Treatment Outcome, Data Collection, Cohort Studies, Selection Bias, Research Design, Publishing, Review Literature as Topic, Randomized Controlled Trials as Topic, Drug-Related Side Effects and Adverse Reactions, Outcome and Process Assessment, Health Care
Depositing User:	Symplectic Admin
Date Deposited:	19 Oct 2016 08:03
Last Modified:	19 Jan 2023 07:29
DOI:	10.1136/bmj.g6501
Open Access URL:	http://www.bmj.com/content/349/bmj.g6501
Related URLs:	Author Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3003846