The accurate reproduction of clinical interventions and the evaluation of provider adherence in research publications improve the evaluation and implementation of research findings into clinical practice. We sought to examine the proportion of clinical pathway publications in an emergency department setting that adequately reported the following: (1) the exact reproduction of the clinical pathway that was implemented in the study, (2) the adherence to and correct execution of the clinical pathway intervention, and (3) the presence of a pre-implementation education phase.
Methods
We performed a descriptive systematic review of the literature from 2006 to 2015 using MEDLINE, EMBASE, CENTRAL, and CINAHL. All types of prospective trial designs were eligible. Validated clinical pathway criteria were used to identify relevant publications. Two reviewers independently collected data using a piloted data abstraction tool. Risk of bias was assessed using the Cochrane Effective Practice and Organization of Care Group Risk of Bias Tool and the Newcastle-Ottawa Scale.
Results
We identified 5947 publications, 44 of which met our inclusion criteria. The formal clinical pathway was fully reproduced in 27 (61%) publications, partially reproduced in 9 (21%), and not reproduced in 8 (18%). Only 14 (32%) studies reported whether at least one decision step was executed correctly. The presence of a pre-implementation education phase was reported in 33 (75%) studies.
Conclusion
The underreporting of intervention elements may present a barrier to both the evaluation and accurate replication of clinical pathway interventions. These finding may be useful for the elaboration of complex intervention reporting guidelines, improved reporting in future clinical pathway publications, and improved knowledge translation and exchange of clinical pathway interventions.
VanhaechtK. The impact of clinical pathways on the organisation of care processes. PhD Thesis, Katholieke Universiteit Leuven, Belgium, 2007.
5.
ZanderKEtheredgeMLBowerK.Nursing case management: blueprints for transformation.
Boston, MA:
New England Medical Center Hospitals, 1987.
6.
VanhaechtKPanellaMZelmRet al.
An overview on the history and concept of care pathways as complex interventions.Int J Care Pathw2010;
14: 117–123.
7.
Institute of Medicine. Hospital-based emergency care: at the breaking point – institute of medicine.
Washington, DC:
The National Academies Press, 2006.
8.
Institute of Medicine. Emergency medical services: at the crossroads.
Washington, DC:
The National Academies Press, 2007.
9.
EveryNRHochmanJBeckerRet al.
Critical pathways: a review.Circulation2000;
101: 461–465.
10.
MouldGBowersJ andGhattasM.The evolution of the pathway and its role in improving patient care.Qual Saf Health Care2010;
19: 1–6.
11.
LougheedMDOlajos-ClowJSzpiroKet al.
Multicentre evaluation of an emergency department asthma care pathway for adults. Can J Emerg Med2009;
11: 214–229.
12.
WillsonABMountainDJeffersJMet al.
Door-to-balloon times are reduced in ST-elevation myocardial infarction by emergency physician activation of the cardiac catheterisation laboratory and immediate patient transfer.Med J Aust2010;
193: 207–212.
13.
NguyenHBCorbettSWSteeleRet al.
Implementation of a bundle of quality indicators for the early management of severe sepsis and septic shock is associated with decreased mortality.Crit Care Med2007;
35: 1105–1112.
14.
ArmstrongRWatersEMooreLet al.
Improving the reporting of public health intervention research: advancing TREND and CONSORT.J Public Health (Oxf)2008;
30: 103–109.
15.
GlasziouPMeatsEHeneghanCet al.
What is missing from descriptions of treatment in trials and reviews?BMJ2008;
336: 1472–1474.
16.
GlentonCUnderlandVKhoMet al.
Summaries of findings, descriptions of interventions, and information about adverse effects would make reviews more informative.J Clin Epidemiol2006;
59: 770–778.
17.
LambSEBeckerCGillespieLDet al.
Reporting of complex interventions in clinical trials: development of a taxonomy to classify and describe fall-prevention interventions.Trials2011;
12: 125.
18.
MichieSFixsenDGrimshawJMet al.
Specifying and reporting complex behaviour change interventions: the need for a scientific method.Implement Sci2009;
4: 40.
19.
OakleyAStrangeVBonellCet al. P
rocess evaluation in randomised controlled trials of complex interventions.BMJ2006;
332: 413–416.
20.
RileyBLMacDonaldJMansiOet al.
Is reporting on interventions a weak link in understanding how and why they work? A preliminary exploration using community heart health exemplars.Implement Sci2008;
3: 27.
21.
RychetnikLFrommerMHawePet al.
Criteria for evaluating evidence on public health interventions.J Epidemiol Commun Health2002;
56: 119–127.
22.
KinsmanLRotterTJamesEet al.
What is a clinical pathway? Development of a definition to inform the debate.BMC Med2010; 8: 31.
23.
ThomsonR.Evidence based implementation of complex interventions.BMJ2009;
339: b3124.
24.
BrownSW andNamethLS.Questions to ask: implementing a system for clinical pathway variance analysis. Outcomes Manag Nurs Pract1998;
2: 57–62; quiz 62–63.
25.
CampbellHHotchkissRBradshawNet al.
Integrated care pathways.BMJ1998;
316: 133–137.
26.
De BleserLDepreitereRDe WaeleKet al.
Defining pathways.J Nurs Manag2006;
14: 553–563.
27.
HyettKLPodoskyMSantamariaNet al.
Valuing variance: the importance of variance analysis in clinical pathways utilisation.Aust Health Rev2007;
31: 565–570.
AltmanDGSchulzKFMoherDet al.
The revised CONSORT statement for reporting randomized trials: explanation and elaboration.Ann Intern Med2001;
134: 663–694.
30.
SchulzKFAltmanDG andMoherD.CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials.BMJ2010;
340: c332.
31.
BoutronIMoherDAltmanDGet al.
Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration.Ann Intern Med2008;
148: 295–309.
32.
ZwarensteinMTreweekSGagnierJJet al.
Improving the reporting of pragmatic trials: an extension of the CONSORT statement.BMJ2008;
337: a2390.
33.
MohlerRBartoszekGKopkeSet al.
Proposed criteria for reporting the development and evaluation of complex interventions in healthcare (CReDECI): guideline development.Int J Nurs Stud2012;
49: 40–46.
34.
OgrincGMooneySEEstradaCet al.
The SQUIRE (Standards for QUality Improvement Reporting Excellence) guidelines for quality improvement reporting: explanation and elaboration.Qual Saf Health Care2008;
17Suppl 1: i13–i32.
35.
Des JarlaisDCLylesC andCrepazN.Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the TREND statement.Am J Public Health2004;
94: 361–366.
36.
HoffmannTCGlasziouPPBoutronIet al.
Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide.BMJ2014;
348: g1687.
37.
MorrisonAPolisenaJHusereauDet al.
The effect of English-language restriction on systematic review-based meta-analyses: a systematic review of empirical studies.Int J Technol Assess Health Care2012;
28: 138–144.
38.
AdjemianRZirkohiAMCoombsRet al.
Validation of descriptive clinical pathway criteria in the systematic identification of publications in emergency medicine.Int J Care Coord2017;
20: 45–56.
Mayo-WilsonE.Reporting implementation in randomized trials: proposed additions to the consolidated standards of reporting trials statement.Am J Public Health2007;
97: 630–633.
42.
ShepperdSLewinSStrausSet al.
Can we systematically review studies that evaluate complex interventions?PLoS Med2009;
6.
43.
CampbellNCMurrayEDarbyshireJet al.
Designing and evaluating complex interventions to improve health care.BMJ2007;
334: 455–459.
44.
ShojaniaKG andGrimshawJM.Evidence-based quality improvement: the state of the science.Health Aff (Millwood)2005;
24: 138–150.
45.
GrimshawJM andEcclesMP.Is evidence-based implementation of evidence-based care possible?Med J Aust2004;
180: S50–S51.
46.
ThorpAW andSchrigerDL.Citations to Web pages in scientific articles: the permanence of archived references. Ann Emerg Med2011;
57: 165–168.
47.
HigginsJPT andGreenS (eds). Cochrane handbook for systematic reviews of interventions. Version 5.1.0, www.cochrane-handbook.org/ (2009, accessed 6 September 2017).
48.
ViswanathanMAnsariMTBerkmanNDet al. Assessing the risk of bias of individual studies in systematic reviews of health care interventions. Agency for Healthcare Research and Quality Methods Guide for Comparative Effectiveness Reviews AHRQ Publication No 12-EHC047-EF, www.effectivehealthcare.ahrq.gov/, (2012, accessed 6 September 2017).
49.
ChernJJMaciasCGJeaAet al.
Effectiveness of a clinical pathway for patients with cerebrospinal fluid shunt malfunction.J Neurosurg Pediatr2010;
6: 318–324.
50.
McCarthyCBrennanJRBrownLet al.
Use of a care bundle in the emergency department for acute exacerbations of chronic obstructive pulmonary disease: a feasibility study. Int J Chron Obstruct Pulmon Dis2013;
8: 605–611.
51.
GuseSENeumanMIO’BrienMet al.
Implementing a guideline to improve management of syncope in the emergency department.Pediatrics2014;
134: e1413–e1421.
52.
GeurtsDH ,VosWMollHAet al.
Impact analysis of an evidence-based guideline on diagnosis of urinary tract infection in infants and young children with unexplained fever.Eur J Pediatr2014;
173: 463–468.
YealyDMKellumJA ,HuangDTet al.
A randomized trial of protocol-based care for early septic shock. N Engl J Med2014;
370: 1683–1693.
55.
AndrewsBMuchemwaLKellyPet al.
Simplified severe sepsis protocol: a randomized controlled trial of modified early goal-directed therapy in Zambia. Crit Care Med2014;
42: 2315–2324.
56.
BekmezianAFeeC andWeberE.Clinical pathway improves pediatrics asthma management in the emergency department and reduces admissions.J Asthma2015;
52: 806–814.
57.
CallegaroSTitomanlioLDonegaSet al.
Implementation of a febrile seizure guideline in two pediatric emergency departments.Pediatr Neurol2009;
40: 78–83.
58.
CalverLADownesMAPageCBet al.
The impact of a standardised intramuscular sedation protocol for acute behavioural disturbance in the emergency department.BMC Emerg Med2010;
10: 14.
CorreiaLCBBritoMKalilFet al.
Effectiveness of a myocardial infarction protocol in reducing door-to-ballon time. Arq Bras Cardiol2013;
101: 26–34.
61.
CroweCAMistryCDRzechulaKet al.
Evaluation of a modified early goal-directed therapy protocol.Am J Emerg Med2010;
28: 689–693.
62.
CruzATPerryAMWilliamsEAet al.
Implementation of goal-directed therapy for children with suspected sepsis in the emergency department.Pediatrics2011;
127: e758–e766.
63.
DalcinPdTRda RochaPMFranciscattoEet al.
Effect of clinical pathways on the management of acute asthma in the emergency department: five years of evaluation.J Asthma2007;
44: 273–279.
64.
DecosterdIHugliOTamchesEet al.
Oligoanalgesia in the emergency department: short-term beneficial effects of an education program on acute pain.Ann Emerg Med2007;
50: 462–471.
65.
DexheimerJWAbramoTJArnoldDHet al.
Implementation and evaluation of an integrated computerized asthma management system in a pediatric emergency department: a randomized clinical trial. Int J Med Inform2014;
83: 805–813.
66.
EnderKLKrajewskiJABabineauJet al.
Use of a clinical pathway to improve the acute management of vaso-occlusive crisis pain in pediatric sickle cell disease.Pediatr Blood Cancer2014;
61: 693–696.
67.
FongCChongWVillaneuvaEet al.
Implementation of a guideline for computed tomography head imaging in head injury: a prospective study.Emerg Med Australas2008;
20: 410–419.
68.
HoegerlCGoldsteinFJ andSartoriusJ.Implementation of a stroke alert protocol in the emergency department: a pilot study. J Am Osteopath Assoc2011;
111: 21–27.
69.
HydenR andFieldsW.Improving the acute myocardial infarction rapid rule out process.J Nurs Care Qual2010;
25: 313–319.
70.
JonesAEFochtAHortonJMet al.
Prospective external validation of the clinical effectiveness of an emergency department-based early goal-directed therapy protocol for severe sepsis and septic shock.Chest2007;
132: 425–432.
71.
KimKLeeCCJoongERet al.
The effects of an institutional care map on the admission rates and medical costs in women with acute pyelonephritis.Acad Emerg Med2008;
15: 319–323.
72.
LauAYSooYOGrahamCAet al.
An expedited stroke triage pathway: the key to shortening the door-to-needle time in delivery of thrombolysis. Hong Kong Med J2010;
16: 455–462.
73.
LiYKLeungCSHuiTLet al.
Acute urinary retention: how useful is an ambulatory care protocol?Hong Kong J Emerg Med2009;
16: 134–140.
74.
MackeyDMylesMSpoonerCHet al.
Changing the process of care and practice in acute asthma in the emergency department: experience with an asthma care map in a regional hospital. Can J Emerg Med2007;
9: 353–365.
75.
MacRedmondRHollohanKStenstromRet al.
Introduction of a comprehensive management protocol for severe sepsis is associated with sustained improvements in timeliness of care and survival.Qual Safety Health Care2010;
19: e46.
76.
SallehFMFathilSMAhmadZet al.
Early goal-directed therapy in the management of severe sepsis/septic shock in an academic Emergency Department in Malaysia. Crit Care Shock2010;
13: 91–97.
77.
MunozCVillanuevaGFoggLet al.
Impact of a subcutaneous insulin protocol in the emergency department: rush emergency department hyperglycemia intervention (REDHI).J Emerg Med2011: 493–498.
78.
NaSKuanWSMahadevanMet al.
Implementation of early goal-directed therapy and the surviving sepsis campaign resuscitation bundle in Asia.Int J Qual Health Care2012;
24: 452–462.
79.
NortonSPPusicMVTahaFet al.
Effect of a clinical pathway on the hospitalisation rates of children with asthma: a prospective study.Arch Dis Child2007;
92: 60–66.
80.
PlambechMZLurieAI andIpsenHL.Initial, successful implementation of sepsis guidelines in an emergency department.Dan Med J2012;
59: A4545.
81.
RatanalertSKornsilpTChintragoolpradubNet al.
The impacts and outcomes of implementing head injury guidelines: clinical experience in Thailand.Emerg Med J2007;
24: 25–30.
82.
RossMAComptonSMedadoPet al.
An emergency department diagnostic protocol for patients with transient ischemic attack: a randomized controlled trial.Ann Emerg Med2007;
50: 109–119.
83.
RussellWSSchuhAMHillJGet al.
Clinical practice guidelines for pediatric appendicitis evaluation can decrease computed tomography utilization while maintaining diagnostic accuracy.Pediatr Emerg Care2013;
29: 568–573.
84.
SairanenTSoinilaSNikkanenMet al.
Two years of Finnish Telestroke: thrombolysis at spokes equal to that at the hub.Neurology2011;
76: 1145–1152.
85.
SantillanesGSimmsSGausche-HillMet al.
Prospective evaluation of a clinical practice guideline for diagnosis of appendicitis in children.Acad Emerg Med2012;
19: 886–893.
86.
SteadLGBellolioMFSuravaramSet al.
Evaluation of transient ischemic attack in an emergency department observation unit.Neurocrit Care2009;
10: 204–208.
87.
ToTWangCDellSDet al.
Can an evidence-based guideline reminder card improve asthma management in the emergency department?Respir Med2010;
104: 1263–1270.
88.
TrompMHulscherMBleeker-RoversCPet al.
The role of nurses in the recognition and treatment of patients with sepsis in the emergency department: a prospective before-and-after intervention study.Int J Nurs Stud2010;
47: 1464–1473.
89.
WangZXiongYSchorrCet al.
Impact of sepsis bundle strategy on outcomes of patients suffering from severe sepsis and septic shock in China.J Emerg Med2013;
44: 735–741.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
