Transparency Matters: Assessing Harms Reporting Compliance in Randomized Controlled Trials Underpinning the AAOS Clinical Practice Guideline for Anterior Cruciate Ligament Injuries

Abstract

Background:

The American Academy of Orthopaedic Surgeons (AAOS) has developed a clinical practice guideline (CPG) for management of anterior cruciate ligament (ACL) injuries. Primary studies such as randomized controlled trials (RCTs) are cited as evidence for the guidelines. Given the influence that these trials have on patient care, adherence to standardized protocols for conducting and reporting RCTs is essential.

Purpose:

To evaluate the CONSORT (Consolidated Standards of Reporting Trials) Extension for Harms–related reporting of RCTs cited as supporting evidence for the AAOS CPG on the management of ACL tears.

Study Design:

Cross-sectional study.

Methods:

The reference section of the AAOS guideline for ACL tears was first screened for RCTs cited in the CPG. Next, each RCT was evaluated for adherence to the CONSORT Extension for Harms checklist. Both identification of RCTs and assessment of adherence were performed in a masked and duplicate process. Descriptive statistics were used to summarize adherence to CONSORT Extension for Harms items. A Pearson correlation test was conducted to assess the relationship between the year of publication and adherence to CONSORT harms reporting.

Results:

The sample included 113 RCTs, of which 16 (14.2%) were published before the CONSORT Extension for Harms was implemented in 2004. Sample sizes ranged from 24 to 4564 participants, with a mean of 228. None of the included RCTs included all 18 items in the CONSORT Extension for Harms checklist. The mean number of checklist items reported was 4 (of 18; 22.2%). A moderate, positive, and statistically significant correlation was found between the RCT publication year and the adherence with reporting of the CONSORT Extension for Harms (t₁₁₁ = 3.54; P < .001) (r = 0.32; 95% CI, 0.14-0.47).

Conclusion:

Harms were infrequently reported in RCTs cited as supporting evidence in the AAOS CPG for the management of ACL tears. One encouraging finding was the positive correlation between the year when RCTs were published and how well they adhered to reporting harms. Efforts to improve adverse event reporting are warranted, as RCTs are commonly used to make clinical decisions in orthopaedic surgery.

Keywords

ACL harms reporting CONSORT CONSORT Extension for Harms clinical practice guidelines

Get full access to this article

View all access options for this article.

References

AAOS updates clinical practice guideline for management of anterior cruciate ligament injuries. Published September 7, 2022. Accessed June 14, 2023. https://www.aaos.org/aaos-home/newsroom/press-releases/aaos-updates-clinical-practice-guideline-for-management-of-anterior-cruciate-ligament-injuries/

Anderson

Howard

Staggs

, et al. Inadequate reporting of complications in randomized controlled trials cited as supporting evidence underpinning AAOS CPG recommendations for hip and knee osteoarthritis: application of the CONSORT harms checklist. J Arthroplasty. 2022;37(12):2466-2472.e2.

Bagul

Kirkham

. The reporting of harms in randomized controlled trials of hypertension using the CONSORT criteria for harm reporting. Clin Exp Hypertens. 2012;34(8):548-554.

Begg

Cho

Eastwood

, et al. Improving the quality of reporting of randomized controlled trials: the CONSORT statement. JAMA. 1996;276(8):637-639.

Boutron

Moher

Altman

Schulz

Ravaud

; CONSORT Group. Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med. 2008;148(4):295-309.

Carlesso

Macdermid

Santaguida

. Standardization of adverse event terminology and reporting in orthopaedic physical therapy: application to the cervical spine. J Orthop Sports Phys Ther. 2010;40(8):455-463.

Electronic Code of Federal Regulations. US Department of Health and Human Services’ Code of Federal Regulation 45 CFR 46.102(d). Accessed May 24, 2023. https://www.ecfr.gov/current/title-45/subtitle-A/subchapter-A/part-46/subpart-A/section-46.102

Evans

Nielson

. Anterior Cruciate Ligament Knee Injury. StatPearls Publishing; 2022.

Goldhahn

Sawaguchi

Audigé

, et al. Complication reporting in orthopaedic trials: a systematic review of randomized controlled trials. J Bone Joint Surg Am. 2009;91(8):1847-1853.

10.

Hodkinson

Kirkham

Tudur-Smith

Gamble

. Reporting of harms data in RCTs: a systematic review of empirical assessments against the CONSORT harms extension. BMJ Open. 2013;3(9):e003436.

11.

ICMJE. Clinical Trials. Accessed June 3, 2021. http://icmje.org/rec ommendations/browse/publishing-and-editorial-issues/clinical-trial-registration.html

12.

Ioannidis

JPA

Evans

SJW

Gøtzsche

, et al. Better reporting of harms in randomized trials: an extension of the CONSORT statement. Ann Intern Med. 2004;141(10):781-788.

13.

Kaeding

Léger-St-Jean

Magnussen

. Epidemiology and diagnosis of anterior cruciate ligament injuries. Clin Sports Med. 2017;36(1):1-8.

14.

Moher

Schulz

Altman

; CONSORT Group. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. Ann Intern Med. 2001;134(8):657-662.

15.

Mohiuddin

Mizubuti

Haroutounian

, et al. Adherence to Consolidated Standards of Reporting Trials (CONSORT) guidelines for reporting safety outcomes in trials of medical cannabis and cannabis-based medicines for chronic noncancer pain: a systematic review. Clin J Pain. 2020;36(4):302-319.

16.

Murad

Wang

. Guidelines for reporting meta-epidemiological methodology research. Evid Based Med. 2017;22(4):139-142.

17.

OrthoGuidelines. Accessed December 30, 2019. http://www.orthoguidelines.org/guidelines

18.

Schulz

Altman

Moher

; CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:C332.

19.

Shamseer

Hopewell

Altman

Moher

Schulz

. Update on the endorsement of CONSORT by high impact factor journals: a survey of journal “instructions to authors” in 2014. Trials. 2016;17(1):301.

20.

Smith

Chang

Pereira

, et al. Adherence to CONSORT harms-reporting recommendations in publications of recent analgesic clinical trials: an ACTTION systematic review. Pain. 2012;153(12):2415-2421.

21.

Thompson

Iyer

Mayfield

Petrigliano

Nicholson

Liu

. Harms reporting in randomized controlled trials underpinning the American Academy of Orthopaedic Surgeons Clinical Practice Guidelines for Distal Radius Fractures. J Hand Surg Am. Published online April 24, 2023. doi: 10.1016/j.jhsa.2023.03.008

22.

Tiamklang

Sumanont

Foocharoen

Laopaiboon

. Double-bundle versus single-bundle reconstruction for anterior cruciate ligament rupture in adults. Cochrane Database Syst Rev. 2012;11:CD008413.

23.

Azuara-Blanco

Kadonosono

, et al. Reporting of complications in retinal detachment surgical trials: a systematic review using the CONSORT Extension for Harms. JAMA Ophthalmol. 2021;139(8):898-905.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.24 MB