Reporting Bias in Systematic Reviews and Meta-Analyses Related to the Treatment of Distal Radius Fractures: The Presence of Spin in the Abstract

Abstract

Background:

Spin is a form of reporting bias which suggests a treatment is beneficial despite a statistically nonsignificant difference in outcomes. Our purpose was to define the prevalence of spin within the abstracts of distal radius fracture (DRF) systematic reviews (SRs) and meta-analyses (MA). We also sought to identify article characteristics that were more likely to contain spin.

Methods:

We performed a SR of multiple databases to identify DRF SRs and MAs. Articles were screened and analyzed by 3 reviewers. We recorded article and journal characteristics including adherence to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, funding disclosures, methodologic quality (AMSTAR 2 instrument), impact factor, and country of origin. Presence of the 9 most severe types of spin in abstracts were recorded. Unadjusted odds ratios (ORs) were calculated to analyze the association between article characteristics and the presence of spin.

Results:

A total of 112 articles were included. Spin was present in 46% of abstracts, with type 1 spin (“conclusions not supported by findings”) most frequent (19%). Spin was present in 43% of abstracts in PRISMA-adhering journals compared to 49% in journals that did not (OR = 0.79, 95% confidence interval [CI] = 0.37-1.68). For articles originating from China, spin was present in 61% of abstracts compared to 39% of abstracts from other countries (OR = 2.55, 95% CI = 1.13-5.75).

Conclusions:

In addition to low article quality, there are high rates of spin within the abstracts of SRs and MAs related to treatment of DRF. Articles within journals that adhere to PRISMA do not appear to contain less spin.