What We Can Learn From Failure: An EHR-Based Child Protection Alert System

Abstract

This study aimed to evaluate the efficacy of a newly implemented Child Protection Alert System (CPAS) that utilizes triggering diagnoses to identify children who have been confirmed/strongly suspected as maltreated. We retrospectively reviewed electronic health records (EHRs) of 666 patients evaluated by our institution’s child protection team between 2009 and 2014. We examined each EHR for the presence of a pop-up alert, a persistent text-based visual alert, and diagnoses denoting child maltreatment. Diagnostic accuracy of the CPAS for child maltreatment identification was assessed. Of 323 patients for whom child maltreatment was confirmed/strongly suspected, 21.7% (70/323) had a qualifying longitudinal diagnosis listed. The pop-up alert fired in 14% of cases (45/323) with a sensitivity and specificity of 13.9% (95% CI [10.4%, 18.2%]) and 100% (95% CI [98.9%, 100.0%]), respectively. The text-based visual alert displayed in 44 of 45 cases. The CPAS is a novel simple way to support clinical decision-making to identify and protect children at risk of (re)abuse. This study highlights multiple barriers that must be overcome to effectively design and implement a CPAS to protect at-risk children.

Keywords

abuse prevention decision-making

Get full access to this article

View all access options for this article.

References

Amland

R. C.

Hahn-Cover

K. E.

(2016). Clinical decision support for early recognition of sepsis. American Journal of Medical Quality, 31, 103–110. doi:10.1177/1062860614557636

Bailhache

Leroy

Pillet

Salmi

L. R.

(2013). Is early detection of abused children possible? A systematic review of the diagnostic accuracy of the identification of abused children. BMC Pediatrics, 13, 202. doi:10.1186/1471-2431-13-202

Blavin

F. E.

Buntin

M. B.

(2013). Forecasting the use of electronic health records: An expert opinion approach. Medicare Medicaid Research Review, 3. doi:10.5600/mmrr.003.02.a02

Carspecken

C. W.

Sharek

P. J.

Longhurst

Pageler

N. M.

(2013). A clinical case of electronic health record drug alert fatigue: Consequences for patient outcome. Pediatrics, 131, e1970–e1973. doi:10.1542/peds.2012-3252

Chang

D. C.

Knight

V. M.

Ziegfeld

Haider

Paidas

(2005). The multi-institutional validation of the new screening index for physical child abuse. Journal of Pediatric Surgery, 13, 114–119. doi:10.1016/j.jpedsurg.2004.09.019

Chauhan

B. F.

Jeyaraman

Mann

A. S.

Lys

Skidmore

Sibley

K. M.

Zarychanski

(2017). Behavior change interventions and policies influencing primary healthcare professionals’ practice—An overview of reviews. Implementation Science, 12, 3. doi:10.1186/s13012-016-0538-8

Christian

C. W.

Crawford-Jakubiak

J. E.

Flaherty

E. G.

Leventhal

J. M.

Lukefahr

J. L.

Sege

R. D.

, & Committee on Child Abuse and Neglect. (2015). The evaluation of suspected child physical abuse. Pediatrics, 135, e1337–e1354. doi:10.1542/peds.2015-0356

Ellaway

B. A.

Payne

E. H.

Rolfe

Dunstan

F. D.

Kemp

A. M.

Butler

Sibert

J. R.

(2004). Are abused babies protected from further abuse? Archives of Disease in Childhood, 89, 845. doi:10.1136/adc.2003.035493

European Society of Radiology. (2017). Summary of the proceedings of the international forum 2016: “Imaging referral guidelines and clinical decision support-how can radiologists implement imaging referral guidelines in clinical routine?” Insights into Imaging, 8, 1–9. doi:10.1007/s13244-016-0523-4

10.

Feng

J. Y.

Chiang

W. L.

T. H.

(2011). What’s new in ICD-10-CM in classifying child maltreatment? Child Abuse & Neglect, 35, 655–657. doi:10.1016/j.chiabu.2011.04.002

11.

Flaherty

E. G.

Sege

R. D.

Griffith

L. L.

Price

Wasserman

Slora

Binns

H. J.

(2008). From suspicion of physical child abuse to reporting: Primary care clinician decision-making. Pediatrics, 122, 611–619. doi:10.1542/peds.2007-2311

12.

Garg

A. X.

Adhikari

N. K.

McDonald

Rosas-Arellano

M. P.

Devereaux

P. J.

Beyene

Haynes

R. B.

(2005). Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: A systematic review. Journal of the American Medical Association, 293, 1223–1238. doi:10.1001/jama.293.10.1223

13.

Hooft

Ronda

Schaeffer

Asnes

A. G.

Leventhal

J. M.

(2013). Identification of physical abuse cases in hospitalized children: Accuracy of International Classification of Diseases codes. Journal of Pediatrics, 162, 80–85. doi:10.1016/j.jpeds.2012.06.037

14.

Kordek

M. E.

(2013). Alert fatigue by other names: Review of contributing fields regarding the “cry wolf” effect. Scholar Archive. Retrieved from http://digitalcommons.ohsu.edu/etd/910

15.

Jaspers

M. W.

Smeulers

Vermeulen

Peute

L. W.

(2011). Effects of clinical decision-support systems on practitioner performance and patient outcomes: A synthesis of high-quality systematic review findings. Journal of the American Medical Informatics Association, 18, 327–34. doi:10.1136/amiajnl-2011-000094

16.

Jenny

Hymel

K. P.

Ritzen

Reinert

S. E.

Hay

T. C.

(1999). Analysis of missed cases of abusive head trauma. Journal of the American Medical Association, 281, 621–626. doi:10.1001/jama.281.7.621

17.

Jia

Zhang

Chen

Zhao

Zhang

(2016). The effects of clinical decision support systems on medication safety: An overview. PLoS One, 11, e0167683. doi:10.1371/journal.pone.0167683

18.

Jones

Flaherty

E. G.

Binns

H. J.

Price

L. L.

Slora

Abney

, … Child Abuse Reporting Experience Study Research Group. (2008). Clinicians’ description of factors influencing their reporting of suspected child abuse: Report of the child abuse reporting experience study research group. Pediatrics, 122, 259–266. doi:10.1542/peds.2007-2312

19.

Kanagasundaram

N. S.

Bevan

M. T.

Sims

A. J.

Heed

Price

D. A.

Sheerin

N. S.

(2016). Computerized clinical decision support for the early recognition and management of acute kidney injury: A qualitative evaluation of end-user experience. Clinical Kidney Journal, 9, 57–62. doi:10.1093/ckj/sfv130

20.

Kaushal

Shojania

K. G.

Bates

D. W.

(2003). Effects of computerized physician order entry and clinical decision support systems on medication safety: A systematic review. Archives of Internal Medicine, 163, 1409–1416. doi:10.1001/archinte.163.12.1409

21.

Kawamoto

Houlihan

C. A.

Balas

E. A.

Lobach

D. F.

(2005). Improving clinical practice using clinical decision support systems: A systematic review of trials to identify features critical to success. British Medical Journal, 330, 765. doi:10.1136/bmj.38398.500764.8F

22.

Kiatchai

Colletti

A. A.

Lyons

V. H.

Grant

R. M.

Vavilala

M. S.

Nair

B. G.

(2017). Development and feasibility of a real-time clinical decision support system for traumatic brain injury anesthesia care. Applied Clinical Informatics, 8, 80–96. doi:10.4338/ACI-2016-10-RA-0164

23.

Lindberg

D. M.

Shapiro

R. A.

Laskey

A. L.

Pallin

D. J.

Blood

E. A.

Berger

R. P.

, & ExSTRA Investigators. (2012). Prevalence of abusive injuries in siblings and household contacts of physically abused children. Pediatrics, 130, 193. doi:10.1542/peds.2012-0085

24.

Louwers

E. C.

Korfage

I. J.

Affourtit

M. J.

Ruige

van den Elzen

A. P.

de Koning

H. J.

Moll

H. A.

(2014). Accuracy of a screening instrument to identify potential child abuse in emergency departments. Child Abuse & Neglect, 38, 1275–1281. doi:10.1016/j.chiabu.2013.11.005

25.

Louwers

E. C.

Korfage

I. J.

Affourtit

M. J.

Scheewe

D. J.

van de Merwe

M. H.

Vooijs-Moulaert

A. F.

de Koning

H. J.

(2012). Effects of systematic screening and detection of child abuse in emergency departments. Pediatrics, 130, 457–64. doi:10.1542/peds.2011-3527

26.

Louwers

E. C.

Korfage

I. J.

Affourtit

M. J.

Scheewe

D. J.

van de Merwe

M. H.

Vooijs-Moulaert

F. A.

De Koning

H. J.

(2011). Detection of child abuse in emergency departments: A multi-centre study. Archives of Disease in Childhood, 96, 422–425. doi:10.1136/adc.2010.202358

27.

Norman

R. E.

Byambaa

Butchart

Scott

Vos

(2012). The long-term health consequences of child physical abuse, emotional abuse, and neglect: A systematic review and meta-analysis. PLoS Medicine, 9, e1001349. doi:10.1371/journal.pmed.1001349

28.

Parrish

Baldwin-Johnson

Volz

Goldsmith

(2013). Abusive head trauma among children in Alaska: A population-based assessment. International Journal of Circumpolar Health, 72, 21216. doi:10.3402/ijch.v72i0.21216.

29.

Pierce

M. C.

Kaczor

Aldridge

O’Flynn

Lorenz

D. J.

(2010). Bruising characteristics discriminating physical child abuse from accidental trauma. Pediatrics, 13, 67–74. doi:10.1542/peds.2008-3632

30.

Raghaven

Brown

D. S.

Allaire

B. T.

Garfield

L. D.

Ross

R. E.

Hedekar

(2015). Challenges in using medicaid claims to ascertain child maltreatment. Child Maltreatment, 20, 83–91. doi:10.1177/1077559514548316

31.

Riney

L. C.

Frey

T. M.

Fain

E. T.

Duma

E. M.

Bennett

B. L.

Kurowski

E. M.

(2018). Standardizing the evaluation of non-accidental trauma in a large pediatric emergency department. Pediatrics, 141, e20171994. doi:10.1542/peds.2017-1994

32.

Roy

P. M.

Durieux

Gillaizeau

Legall

Armand-Perroux

Martino

Meyer

(2009). A computerized handheld decision-support system to improve pulmonary embolism diagnosis: A randomized trial. Annals of Internal Medicine, 151, 677–686. doi:10.7326/0003-4819-151-10-200911170-00003

33.

Rumball-Smith

Fromkin

Rosenthal

Shane

Skrbin

Bimber

Berger

R. P.

(2018). Implementation of routine electronic health record-based child abuse screening in General Emergency Departments. Child Abuse & Neglect, 85, 58–67. doi:10.1016/j.chiabu.2018.08.008

34.

Samore

Bateman

Alder

Hannah

Donnelly

Stoddard

G. J.

Stevenson

(2005). Clinical decision support and appropriateness of antimicrobial prescribing: A randomized trial. Journal of the American Medical Association, 294, 2305–2314. doi:10.1001/jama.294.18.2305

35.

Schilling

Fortin

Forkey

(2015). Medical management and trauma-informed care for children in foster care. Current Problems in Pediatric and Adolescent Health Care, 45, 298–305. doi:10.1016/j.cppeds.2015.08.004

36.

Schnitzer

P. G.

Slusher

P. L.

Kruse

R. L.

Tarleton

M. M.

(2011). Identification of ICD codes suggestive of child maltreatment. Child Abuse and Neglect, 35, 3–17. doi:10.1016/j.chiabu.2010.06.008

37.

Sedlak

A. J.

Mettenburg

Basena

Petta

McPherson

Greene

(2010). Fourth national incidence study of child abuse and neglect (NIS–4): Report to Congress (pp. 5–6). Washington, DC: U.S. Department of Health and Human Services, Administration for Children and Families.

38.

Sege

Amaya-Jackson

, American Academy of Pediatrics Committee on Child Abuse and Neglect, Council on Foster Care, Adoption, and Kinship Care, American Academy of Child and Adolescent Psychiatry Committee on Child Maltreatment and Violence, & National Center for Child Traumatic Stress. (2017). Clinical considerations related to the behavioral manifestations of child maltreatment. Pediatrics, 139, e20170100. doi:10.1542/peds.2017-0100

39.

Sittig

D. F.

Wright

Meltzer

Simonaitis

Evans

R. S.

Nichol

W. P.

Middleton

(2011). Comparison of clinical knowledge management capabilities of commercially-available and leading internally-developed electronic health records. BMC Medical Informatics and Decision Making, 11, 13. doi:10.1186/1472-6947-11-13

40.

Teeuw

A. H.

Derkx

B. H.

Koster

W. A.

van Rijn

R. R

. (2012). Educational paper: Detection of child abuse and neglect at the emergency room. European Journal of Pediatrics, 171, 877–885. doi:10.1007/s00431-011-1551-1

41.

Tran

Luo

Phung

Harvey

Berk

Kennedy

R. L.

Venkatesh

(2014). Risk stratification using data from electronic medical records better predicts suicide risks than clinician assessments. BMC Psychiatry, 14, 76. doi:10.1186/1471-244X-14-76

42.

U.S. Department of Health and Human Services, Administration for Children and Families, Administration on Children, Youth and Families, Children’s Bureau. (2012). Child maltreatment. Retrieved from http://www.acf.hhs.gov/programs/cb/research-data-technology/statistics-research/child-maltreatment

43.

Valvano

T. J.

Binns

H. J.

Flaherty

E. G.

Leonhardt

D. E.

(2009). Does bruising help determine which fractures are caused by abuse? Child Maltreatment, 13, 376–381. doi:10.1177/1077559508326356

44.

Van der Sijs

Aarts

Vulto

Berg

(2006). Overriding of drug safety alerts in computerized physician order entry. Journal of the American Medical Informatics Association, 13, 138–147. doi:10.1197/jamia.M1809

45.

Wood

J. N.

Feudtner

Medina

S. P.

Luan

Localio

Rubin

D. M.

(2012). Variation in occult injury screening for children with suspected abuse in selected US children’s hospitals. Pediatrics, 130, 853–860. doi:10.1542/peds.2012-0244

46.

Wood

J. N.

French

Song

Feudtner

(2015). Evaluation for occult fractures in injured children. Pediatrics, 136, 232–240. doi:10.1542/peds.2014-3977

47.

Woodman

Pitt

Wentz

Taylor

Hodes

Gilbert

R. E

. (2008). Performance of screening tests for child physical abuse in accident and emergency departments. Health Technology Assessment, 12, iii, xi–xiii, 1–95. doi:10.3310/hta12330

48.

Zimmerman

Mercy

J. A.

(2010). A better start: Child maltreatment as a public health priority. Retrieved from https://vetoviolence.cdc.gov/apps/phl/docs/A_Better_Start.pdf

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.19 MB