This study aimed to evaluate the efficacy of a newly implemented Child Protection Alert System (CPAS) that utilizes triggering diagnoses to identify children who have been confirmed/strongly suspected as maltreated. We retrospectively reviewed electronic health records (EHRs) of 666 patients evaluated by our institution’s child protection team between 2009 and 2014. We examined each EHR for the presence of a pop-up alert, a persistent text-based visual alert, and diagnoses denoting child maltreatment. Diagnostic accuracy of the CPAS for child maltreatment identification was assessed. Of 323 patients for whom child maltreatment was confirmed/strongly suspected, 21.7% (70/323) had a qualifying longitudinal diagnosis listed. The pop-up alert fired in 14% of cases (45/323) with a sensitivity and specificity of 13.9% (95% CI [10.4%, 18.2%]) and 100% (95% CI [98.9%, 100.0%]), respectively. The text-based visual alert displayed in 44 of 45 cases. The CPAS is a novel simple way to support clinical decision-making to identify and protect children at risk of (re)abuse. This study highlights multiple barriers that must be overcome to effectively design and implement a CPAS to protect at-risk children.
AmlandR. C.Hahn-CoverK. E. (2016). Clinical decision support for early recognition of sepsis. American Journal of Medical Quality, 31, 103–110. doi:10.1177/1062860614557636
2.
BailhacheM.LeroyV.PilletP.SalmiL. R. (2013). Is early detection of abused children possible? A systematic review of the diagnostic accuracy of the identification of abused children. BMC Pediatrics, 13, 202. doi:10.1186/1471-2431-13-202
3.
BlavinF. E.BuntinM. B. (2013). Forecasting the use of electronic health records: An expert opinion approach. Medicare Medicaid Research Review, 3. doi:10.5600/mmrr.003.02.a02
4.
CarspeckenC. W.SharekP. J.LonghurstC.PagelerN. M. (2013). A clinical case of electronic health record drug alert fatigue: Consequences for patient outcome. Pediatrics, 131, e1970–e1973. doi:10.1542/peds.2012-3252
5.
ChangD. C.KnightV. M.ZiegfeldS.HaiderA.PaidasC. (2005). The multi-institutional validation of the new screening index for physical child abuse. Journal of Pediatric Surgery, 13, 114–119. doi:10.1016/j.jpedsurg.2004.09.019
ChristianC. W.Crawford-JakubiakJ. E.FlahertyE. G.LeventhalJ. M.LukefahrJ. L.SegeR. D., & Committee on Child Abuse and Neglect. (2015). The evaluation of suspected child physical abuse. Pediatrics, 135, e1337–e1354. doi:10.1542/peds.2015-0356
8.
EllawayB. A.PayneE. H.RolfeK.DunstanF. D.KempA. M.ButlerI.SibertJ. R. (2004). Are abused babies protected from further abuse?Archives of Disease in Childhood, 89, 845. doi:10.1136/adc.2003.035493
9.
European Society of Radiology. (2017). Summary of the proceedings of the international forum 2016: “Imaging referral guidelines and clinical decision support-how can radiologists implement imaging referral guidelines in clinical routine?”Insights into Imaging, 8, 1–9. doi:10.1007/s13244-016-0523-4
10.
FengJ. Y.ChiangW. L.LuT. H. (2011). What’s new in ICD-10-CM in classifying child maltreatment?Child Abuse & Neglect, 35, 655–657. doi:10.1016/j.chiabu.2011.04.002
11.
FlahertyE. G.SegeR. D.GriffithL. L.PriceR.WassermanE.SloraE.BinnsH. J. (2008). From suspicion of physical child abuse to reporting: Primary care clinician decision-making. Pediatrics, 122, 611–619. doi:10.1542/peds.2007-2311
12.
GargA. X.AdhikariN. K.McDonaldH.Rosas-ArellanoM. P.DevereauxP. J.BeyeneJ.HaynesR. B. (2005). Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: A systematic review. Journal of the American Medical Association, 293, 1223–1238. doi:10.1001/jama.293.10.1223
13.
HooftA.RondaJ.SchaefferP.AsnesA. G.LeventhalJ. M. (2013). Identification of physical abuse cases in hospitalized children: Accuracy of International Classification of Diseases codes. Journal of Pediatrics, 162, 80–85. doi:10.1016/j.jpeds.2012.06.037
14.
KordekM. E. (2013). Alert fatigue by other names: Review of contributing fields regarding the “cry wolf” effect. Scholar Archive. Retrieved fromhttp://digitalcommons.ohsu.edu/etd/910
15.
JaspersM. W.SmeulersM.VermeulenH.PeuteL. W. (2011). Effects of clinical decision-support systems on practitioner performance and patient outcomes: A synthesis of high-quality systematic review findings. Journal of the American Medical Informatics Association, 18, 327–34. doi:10.1136/amiajnl-2011-000094
16.
JennyC.HymelK. P.RitzenA.ReinertS. E.HayT. C. (1999). Analysis of missed cases of abusive head trauma. Journal of the American Medical Association, 281, 621–626. doi:10.1001/jama.281.7.621
17.
JiaP.ZhangL.ChenJ.ZhaoP.ZhangM. (2016). The effects of clinical decision support systems on medication safety: An overview. PLoS One, 11, e0167683. doi:10.1371/journal.pone.0167683
18.
JonesR.FlahertyE. G.BinnsH. J.PriceL. L.SloraE.AbneyD., … Child Abuse Reporting Experience Study Research Group. (2008). Clinicians’ description of factors influencing their reporting of suspected child abuse: Report of the child abuse reporting experience study research group. Pediatrics, 122, 259–266. doi:10.1542/peds.2007-2312
19.
KanagasundaramN. S.BevanM. T.SimsA. J.HeedA.PriceD. A.SheerinN. S. (2016). Computerized clinical decision support for the early recognition and management of acute kidney injury: A qualitative evaluation of end-user experience. Clinical Kidney Journal, 9, 57–62. doi:10.1093/ckj/sfv130
20.
KaushalR.ShojaniaK. G.BatesD. W. (2003). Effects of computerized physician order entry and clinical decision support systems on medication safety: A systematic review. Archives of Internal Medicine, 163, 1409–1416. doi:10.1001/archinte.163.12.1409
21.
KawamotoK.HoulihanC. A.BalasE. A.LobachD. F. (2005). Improving clinical practice using clinical decision support systems: A systematic review of trials to identify features critical to success. British Medical Journal, 330, 765. doi:10.1136/bmj.38398.500764.8F
22.
KiatchaiT.CollettiA. A.LyonsV. H.GrantR. M.VavilalaM. S.NairB. G. (2017). Development and feasibility of a real-time clinical decision support system for traumatic brain injury anesthesia care. Applied Clinical Informatics, 8, 80–96. doi:10.4338/ACI-2016-10-RA-0164
23.
LindbergD. M.ShapiroR. A.LaskeyA. L.PallinD. J.BloodE. A.BergerR. P., & ExSTRA Investigators. (2012). Prevalence of abusive injuries in siblings and household contacts of physically abused children. Pediatrics, 130, 193. doi:10.1542/peds.2012-0085
24.
LouwersE. C.KorfageI. J.AffourtitM. J.RuigeM.van den ElzenA. P.de KoningH. J.MollH. A. (2014). Accuracy of a screening instrument to identify potential child abuse in emergency departments. Child Abuse & Neglect, 38, 1275–1281. doi:10.1016/j.chiabu.2013.11.005
25.
LouwersE. C.KorfageI. J.AffourtitM. J.ScheeweD. J.van de MerweM. H.Vooijs-MoulaertA. F.de KoningH. J. (2012). Effects of systematic screening and detection of child abuse in emergency departments. Pediatrics, 130, 457–64. doi:10.1542/peds.2011-3527
26.
LouwersE. C.KorfageI. J.AffourtitM. J.ScheeweD. J.van de MerweM. H.Vooijs-MoulaertF. A.De KoningH. J. (2011). Detection of child abuse in emergency departments: A multi-centre study. Archives of Disease in Childhood, 96, 422–425. doi:10.1136/adc.2010.202358
27.
NormanR. E.ByambaaM.DeR.ButchartA.ScottJ.VosT. (2012). The long-term health consequences of child physical abuse, emotional abuse, and neglect: A systematic review and meta-analysis. PLoS Medicine, 9, e1001349. doi:10.1371/journal.pmed.1001349
28.
ParrishJ.Baldwin-JohnsonC.VolzM.GoldsmithY. (2013). Abusive head trauma among children in Alaska: A population-based assessment. International Journal of Circumpolar Health, 72, 21216. doi:10.3402/ijch.v72i0.21216.
29.
PierceM. C.KaczorK.AldridgeS.O’FlynnJ.LorenzD. J. (2010). Bruising characteristics discriminating physical child abuse from accidental trauma. Pediatrics, 13, 67–74. doi:10.1542/peds.2008-3632
30.
RaghavenR.BrownD. S.AllaireB. T.GarfieldL. D.RossR. E.HedekarD. (2015). Challenges in using medicaid claims to ascertain child maltreatment. Child Maltreatment, 20, 83–91. doi:10.1177/1077559514548316
31.
RineyL. C.FreyT. M.FainE. T.DumaE. M.BennettB. L.KurowskiE. M. (2018). Standardizing the evaluation of non-accidental trauma in a large pediatric emergency department. Pediatrics, 141, e20171994. doi:10.1542/peds.2017-1994
32.
RoyP. M.DurieuxP.GillaizeauF.LegallC.Armand-PerrouxA.MartinoL.MeyerG. (2009). A computerized handheld decision-support system to improve pulmonary embolism diagnosis: A randomized trial. Annals of Internal Medicine, 151, 677–686. doi:10.7326/0003-4819-151-10-200911170-00003
33.
Rumball-SmithJ.FromkinJ.RosenthalB.ShaneD.SkrbinJ.BimberT.BergerR. P. (2018). Implementation of routine electronic health record-based child abuse screening in General Emergency Departments. Child Abuse & Neglect, 85, 58–67. doi:10.1016/j.chiabu.2018.08.008
34.
SamoreM.BatemanK.AlderS.HannahE.DonnellyS.StoddardG. J.StevensonK. (2005). Clinical decision support and appropriateness of antimicrobial prescribing: A randomized trial. Journal of the American Medical Association, 294, 2305–2314. doi:10.1001/jama.294.18.2305
35.
SchillingS.FortinK.ForkeyH. (2015). Medical management and trauma-informed care for children in foster care. Current Problems in Pediatric and Adolescent Health Care, 45, 298–305. doi:10.1016/j.cppeds.2015.08.004
36.
SchnitzerP. G.SlusherP. L.KruseR. L.TarletonM. M. (2011). Identification of ICD codes suggestive of child maltreatment. Child Abuse and Neglect, 35, 3–17. doi:10.1016/j.chiabu.2010.06.008
37.
SedlakA. J.MettenburgJ.BasenaM.PettaI.McPhersonK.GreeneA.LiS. (2010). Fourth national incidence study of child abuse and neglect (NIS–4): Report to Congress (pp. 5–6). Washington, DC: U.S. Department of Health and Human Services, Administration for Children and Families.
38.
SegeR.Amaya-JacksonL., American Academy of Pediatrics Committee on Child Abuse and Neglect, Council on Foster Care, Adoption, and Kinship Care, American Academy of Child and Adolescent Psychiatry Committee on Child Maltreatment and Violence, & National Center for Child Traumatic Stress. (2017). Clinical considerations related to the behavioral manifestations of child maltreatment. Pediatrics, 139, e20170100. doi:10.1542/peds.2017-0100
39.
SittigD. F.WrightA.MeltzerS.SimonaitisL.EvansR. S.NicholW. P.MiddletonB. (2011). Comparison of clinical knowledge management capabilities of commercially-available and leading internally-developed electronic health records. BMC Medical Informatics and Decision Making, 11, 13. doi:10.1186/1472-6947-11-13
40.
TeeuwA. H.DerkxB. H.KosterW. A.van RijnR. R. (2012). Educational paper: Detection of child abuse and neglect at the emergency room. European Journal of Pediatrics, 171, 877–885. doi:10.1007/s00431-011-1551-1
41.
TranT.LuoW.PhungD.HarveyR.BerkM.KennedyR. L.VenkateshS. (2014). Risk stratification using data from electronic medical records better predicts suicide risks than clinician assessments. BMC Psychiatry, 14, 76. doi:10.1186/1471-244X-14-76
ValvanoT. J.BinnsH. J.FlahertyE. G.LeonhardtD. E. (2009). Does bruising help determine which fractures are caused by abuse?Child Maltreatment, 13, 376–381. doi:10.1177/1077559508326356
44.
Van der SijsH.AartsJ.VultoA.BergM. (2006). Overriding of drug safety alerts in computerized physician order entry. Journal of the American Medical Informatics Association, 13, 138–147. doi:10.1197/jamia.M1809
45.
WoodJ. N.FeudtnerC.MedinaS. P.LuanX.LocalioR.RubinD. M. (2012). Variation in occult injury screening for children with suspected abuse in selected US children’s hospitals. Pediatrics, 130, 853–860. doi:10.1542/peds.2012-0244
46.
WoodJ. N.FrenchB.SongL.FeudtnerC. (2015). Evaluation for occult fractures in injured children. Pediatrics, 136, 232–240. doi:10.1542/peds.2014-3977
47.
WoodmanJ.PittM.WentzR.TaylorB.HodesD.GilbertR. E. (2008). Performance of screening tests for child physical abuse in accident and emergency departments. Health Technology Assessment, 12, iii, xi–xiii, 1–95. doi:10.3310/hta12330
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
