Appraising Otolaryngology–Head and Neck Surgery Clinical Practice Guidelines for Effective Dissemination and Implementation Design

Abstract

Objectives

Dissemination and implementation (D&I) science analyzes interventional strategies that aid in spreading scientific knowledge, adopting evidence into practice, and identifying barriers to maximize successful integration of science into practice. This study set out to critically appraise the published D&I strategies of the American Academy of Otolaryngology–Head and Neck Surgery Foundation (AAO-HNSF) Clinical Practice Guidelines (CPGs) and to introduce the theories of D&I science.

Methods

The 15 AAO-HNSF CPGs underwent appraisal by 2 independent reviewers using the Appraisal of Guidelines for Research & Evaluation II (AGREE II) instrument. CPGs were rated over 23 key items in 6 domains. Each item was rated on a 7-point scale from 1 (strongly disagree) to 7 (strongly agree). CPGs were rated and quality assessments were performed. Intrarater reliability was assessed.

Results

The overall mean score of the CPGs was 85.2% (95% confidence interval, 83.4%-86.9%). Individual CPG mean scores ranged from 80.4% to 90.9%. Mean interrater reliability was strong. All domains of the AGREE II instrument, except the Applicability domain, scored a mean of 90.7% or better. D&I strategies within the CPGs, as calculated by the Applicability domain score, ranged from 22.9% to 77.1%.

Discussion

There is a paucity of published D&I strategies within the AAO-HNSF CPGs. Nesting a D&I framework, such as the Quality Improvement Framework, within CPGs would allow for identification of barriers to CPG adoption and evaluation of CPG-directed interventions.

Implications for Practice

A D&I framework within the AAO-HNSF CPGs would allow for objective measurement of the overall impact of CPGs on otolaryngology practices.